-- Logs begin at Tue 2022-07-26 06:44:28 UTC, end at Tue 2022-07-26 07:46:07 UTC. -- Jul 26 07:12:47.971431 dv-cinder-850836-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 07:12:47.983933 dv-cinder-850836-1-smb devstack@keystone.service[80178]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 07:12:47 2022] *** Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: nodename: dv-cinder-850836-1-smb Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: machine: x86_64 Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: clock source: unix Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: pcre jit disabled Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: detected number of CPU cores: 4 Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: current working directory: / Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: detected binary path: /usr/bin/uwsgi-core Jul 26 07:12:47.987894 dv-cinder-850836-1-smb devstack@keystone.service[80178]: your processes number limit is 47680 Jul 26 07:12:47.988954 dv-cinder-850836-1-smb devstack@keystone.service[80178]: your memory page size is 4096 bytes Jul 26 07:12:47.988954 dv-cinder-850836-1-smb devstack@keystone.service[80178]: detected max file descriptor number: 2048 Jul 26 07:12:47.988954 dv-cinder-850836-1-smb devstack@keystone.service[80178]: lock engine: pthread robust mutexes Jul 26 07:12:47.988954 dv-cinder-850836-1-smb devstack@keystone.service[80178]: thunder lock: enabled Jul 26 07:12:47.988954 dv-cinder-850836-1-smb devstack@keystone.service[80178]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 07:12:47.988954 dv-cinder-850836-1-smb devstack@keystone.service[80178]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 07:12:48.029996 dv-cinder-850836-1-smb devstack@keystone.service[80178]: Python main interpreter initialized at 0x55b10f5d99c0 Jul 26 07:12:48.029996 dv-cinder-850836-1-smb devstack@keystone.service[80178]: python threads support enabled Jul 26 07:12:48.029996 dv-cinder-850836-1-smb devstack@keystone.service[80178]: your server socket listen backlog is limited to 100 connections Jul 26 07:12:48.029996 dv-cinder-850836-1-smb devstack@keystone.service[80178]: your mercy for graceful operations on workers is 90 seconds Jul 26 07:12:48.030539 dv-cinder-850836-1-smb devstack@keystone.service[80178]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 07:12:48.030539 dv-cinder-850836-1-smb devstack@keystone.service[80178]: *** Operational MODE: preforking *** Jul 26 07:12:48.030738 dv-cinder-850836-1-smb devstack@keystone.service[80178]: *** uWSGI is running in multiple interpreter mode *** Jul 26 07:12:48.030738 dv-cinder-850836-1-smb devstack@keystone.service[80178]: spawned uWSGI master process (pid: 80178) Jul 26 07:12:48.031017 dv-cinder-850836-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 26 07:12:48.031580 dv-cinder-850836-1-smb devstack@keystone.service[80178]: spawned uWSGI worker 1 (pid: 80191, cores: 1) Jul 26 07:12:48.037295 dv-cinder-850836-1-smb devstack@keystone.service[80178]: spawned uWSGI worker 2 (pid: 80192, cores: 1) Jul 26 07:12:48.037295 dv-cinder-850836-1-smb devstack@keystone.service[80178]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 07:12:53.725706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:12:53.725706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes Jul 26 07:12:53.726612 dv-cinder-850836-1-smb devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:12:53.726612 dv-cinder-850836-1-smb devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes Jul 26 07:12:53.777426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 07:12:53.777690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 07:12:53.777820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] command line args: [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 07:12:53.778040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 07:12:53.778196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ================================================================================ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 07:12:53.778452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.778698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] config_dir = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.778869 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.779032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] config_source = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.779228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] debug = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.779406 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.779797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.779965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.780203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.780450 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.780681 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.780850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_config_append = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.781007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.781164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_dir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.781382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.781592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.781841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.782086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.782333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.782501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.782660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.782901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.783140 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.783392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.783618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.783843 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.784076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.784335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.784555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.784838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.785436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.785648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] publish_errors = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.785873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.786133 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.786298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.786531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.786756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.786981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] standard_threads = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.787205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.787444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.787635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.787803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_journal = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.787954 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_json = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.788129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_stderr = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.788309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] use_syslog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.788541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:53.788788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.789039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.789304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.789559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.789806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.790046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.790288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.790523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.790768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.791013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.791261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.791478 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.791731 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.791955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.792199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.792446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.792682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.792935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.793187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.793460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.793695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.793947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.794204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.794456 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.794704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.794934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.795164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.795398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.795629 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.795878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.796121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.796349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.796577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.796822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.797067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.797324 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.797573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.797802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.798037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.798273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.798504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.798734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.798964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.799196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.799432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.799681 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.799922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.800150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.800380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.800615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.800849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.801097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.801351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.801760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.802094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.802423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.802749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.803087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.803437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.803787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.804112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.804439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.804796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.805067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.805335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.805573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.805814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.806052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.806326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.806566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.806815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.807066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.807303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.807538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.807774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.808025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.808263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.808499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.808743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.808981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.809218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.809481 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.809716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.809951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.810217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.810461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.810773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.811219 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.811667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.812083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.812494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.812752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.813046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.813335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.813575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.813813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.814045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.814290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.814525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.814776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.815014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.815277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.815539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.815782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.816016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.external = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.816248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.816545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.816777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.816777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.password = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.816777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.token = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.817841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.817841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.818048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.818195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.818444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.818695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.818925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.819161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.819409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.819659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.819907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.820145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.820391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.820625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.820903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.821158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.821419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.821674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.821964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.822211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.822477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.822720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.822977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.823213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.823461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.823713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.823957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.824189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.824436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.824675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.824930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.825173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.825455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.825692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.825950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.826188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.826436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.826685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.826922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.827159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.827408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.827640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.827878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.828128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.828383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.828614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.828846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.829075 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.829338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.829586 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.829832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.830088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.830556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.830747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.830896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.831044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.831281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.831519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.831769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.831981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.832222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.832463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.832825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.833063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.833340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.833590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.833826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.834072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.834319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.834548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.834787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.835019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.835263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.835501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.835750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.835986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.836238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.836471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.836718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.836951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.837181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.837455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.837703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.837939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.838172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.838407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.838637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.838878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.839134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.839365 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.839612 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.839855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.840099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.840331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.840560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.840794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.841026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.841284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.841510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.841757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.842002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.842246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.842640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.842888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.843120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.843368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.843605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.843845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.844083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.844685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.844935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.845180 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.845445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.845702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.845930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.846173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.846409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.846641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.846879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.847124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.847366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.847598 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.847834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.848072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.848350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.848600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.848835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.849084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.849354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.849592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.849837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.850073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.850311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.850543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] role.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.850789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] role.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.851018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.851267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.851512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.851757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.852002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.852246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.852490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.852732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.852977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.853209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.853481 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.853727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.853973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.854228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.854666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.854901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.855146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.855399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.855645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.855892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.856126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.856381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.856633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.856871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.857100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.857355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.857588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.857839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.858094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.858343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.858579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.858908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.859142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.859380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.859619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.859864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.860099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.860354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.860599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.860834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.861078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.861344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.861592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.861833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.862069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.862300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.862545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.862792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.863020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.863260 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.863550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.863809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.864114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.864361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.864600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.864838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.865071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.865338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.865574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.865810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.866051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.866288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.866529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.866766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.867010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.867242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.867486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.867717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.867955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.868189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:53.868357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 07:12:53.898605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:53.898817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:53.898961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:53.907596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:12:53.907596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: from cryptography.utils import int_from_bytes Jul 26 07:12:53.908224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:53.908357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:12:53.908357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: from cryptography.utils import int_from_bytes Jul 26 07:12:53.938196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:53.938469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:53.992448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:53.997697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 07:12:53.998038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 07:12:53.998372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] command line args: [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 07:12:53.998854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 07:12:53.999174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ================================================================================ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 07:12:53.999629 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] admin_token = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.000083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] config_dir = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.000421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.000768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] config_source = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.001091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] debug = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.001488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.001918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.002237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.002709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.003170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.003608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.003930 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] log_config_append = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.004255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.004620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] log_dir = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.004956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] log_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.005431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.005894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.006358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.006812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.007132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.007468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.007920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.008369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.008804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.009241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.009707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.010140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.010599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.011070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.011585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.012507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.012838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] publish_errors = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.013313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.013743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.014082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.014530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.014985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.015423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] standard_threads = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.015864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.016310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.016641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.016974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] use_journal = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.017342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] use_json = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.017680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] use_stderr = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.018020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] use_syslog = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.018463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:12:54.018964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.019416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.019907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.020436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.020906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.021398 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.021854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.022289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.022764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.023239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.023695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.024133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.024589 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.025022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.025526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.025994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.026433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.026908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.027386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.027848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.028288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.028765 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.029255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.029774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.030244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.030692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.031145 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.031582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.032044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.032510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.032987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.033477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.033926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.034406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.034895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.035365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.035904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.036361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.036822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.037334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.037762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.038212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.038650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.039096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.039543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.039992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.040441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.040902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.041389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.041840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.042290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.042754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.043203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.043663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.044112 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.044577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.045033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.045307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.045516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.045628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.045963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.046431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.046889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.047347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.047782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.048269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.048731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.049182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.049671 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.050128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.050651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.051094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.051639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.052125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.052573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.053012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.053523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.053993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.054436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.054885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.055367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.055834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.056294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.056727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.057194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.057698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.058187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.058664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.059121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.059568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.060039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.060512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.060973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.061450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.061895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.062351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.062792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.063254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.063703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.064153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.064586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.065077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.065565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.066033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.066537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.067013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.067514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.external = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.067958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.068536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.068986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.069450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.password = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.069881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.token = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.070352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.070806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.071267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.071722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.072204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.072667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.073101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.073594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.074075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.074539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.075002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.075470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.075943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.076406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.076907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.077406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.077871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.078356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.078887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.079369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.079876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.080328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.080815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.081294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.081738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.082199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.082701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.083148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.083604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.084072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.084567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.085001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.085511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.085977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.086457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.086914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.087397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.087855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.088290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.088731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.089209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.089689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.090164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.090635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.091104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.091551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.091995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.092435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.092916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.093440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.093916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.094728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.095191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.095702 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.096161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.096697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.097163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.097667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.098113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.098639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.099113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.099592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.100022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.100429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.100838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.101307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.101717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.102193 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.102669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.103115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.103567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.103996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.104438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.104882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.105357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.105803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.106252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.106721 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.107190 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.107647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.108097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.108575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.109059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.109592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.110006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.110466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.110956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.111367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.111864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.112317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.112434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.112621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.112754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.112868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.112981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.113160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.113298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.113438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.113722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.114180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.114623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.115068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.115523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.115960 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.116391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.116871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.117376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.117864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.118334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.118791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.119228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.119704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.120174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.120611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.121064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.121563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.122036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.122486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.122929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.123434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.123883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.124344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.124789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.125245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.125726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.126428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.126873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.127312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.127778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.128238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.128738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.129207 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.129754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.130247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.130729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.131182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.131659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.132094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.132555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.133002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] role.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.133495 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] role.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.133946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.134431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.134895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.135359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.135830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.136322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.136802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.137204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.137392 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.137518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.137691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.137802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.137918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.138127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.138250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.138363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.138544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.138656 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.139052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.139563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.140033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.140797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.141280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.141755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.142219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.142708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.143200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.143663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.144137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.144628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.145086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.145589 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.146043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.146492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.146955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.147441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.147921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.148366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.148854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.149288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.149734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] token.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.150183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.150358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.150648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.151113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.151602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.152087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.152534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.152990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.153498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.153972 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.154416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.154865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.155318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.155778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.156249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.156701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.157171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.157752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.158236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.158689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.159147 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.159601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.160066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.160515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.161023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.161493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.161934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.162392 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.162855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.163347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.163458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.163639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.163813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.163923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.164054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.164280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.164391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.164512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.164691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.165079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.165192 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.165647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.166099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.166543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:12:54.166863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 07:12:54.181930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.182141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 07:12:54.182459 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.182645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 07:12:54.182939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.183196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.183450 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.183704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.193647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.193907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.194199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.194480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.201495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.206376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.206636 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.206914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.207194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.207475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.207796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.208063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.208341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.208613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.208896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.209143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.214799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.215197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.215602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.232408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.232845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.234410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.234696 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.239422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.239701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.239979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.246764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.247055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.251239 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.251525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.251821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.252098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.252371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.252651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.252924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.253193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.269303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.269566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.269808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.270227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.273594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.276754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.277049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.281505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.284690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.288076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.288375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.288656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.288951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.289217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.289561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.305676 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.305951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.306240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.306496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.313465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.315036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.315333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.318326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.318597 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.318890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.319166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.319440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.331085 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.331364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.331666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.331945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.332222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.332494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.332820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.342150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.349019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.352060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.355039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.357759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.359280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.359579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.359893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.366617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.368239 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.371215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.371503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.371784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.372054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.380249 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.380554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.380863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.387949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.388212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.388517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.389127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.389127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.389480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.389625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.389893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.390268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.390550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.390827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.391094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.391368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.391625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.406096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.406449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.425163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b10f5d99c0 pid: 80192 (default app) Jul 26 07:12:54.428939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4580030-9fb9-4cf2-9a12-afa7960ef65c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:12:54.429220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4580030-9fb9-4cf2-9a12-afa7960ef65c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:12:54.429526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4580030-9fb9-4cf2-9a12-afa7960ef65c None None] PATH_INFO: `/v3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:12:54.434008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Tue Jul 26 07:12:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:12:54.450028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.450248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.450469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.450699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.450927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.451138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.464850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.465096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.465344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.465535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.465752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.465961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.466323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.475169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.478563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.478781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.479018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.479221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.479440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.479657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.479869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:12:54.490663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.490895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 07:12:54.491201 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.491404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 07:12:54.491676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.491951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.492224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.492476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.502477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.502762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.503041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.503323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.510546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.515638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.515931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.516224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.516514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.516778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.517063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.517342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.517622 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.517906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.518197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.518470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.542025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.543574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.543868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.548889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.548889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.549401 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.557738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.558458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.566652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.567161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.567553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.567883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.568335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.569061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.569344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.569903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.598717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.599219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.607829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.614548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.615078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.623917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.630436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.636848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.637387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.637838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.638314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.638798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.639283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.670868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.671101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.671387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.671655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.678747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.680342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.680612 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.683473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.683763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.684046 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.684297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.684597 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.696235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.696561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.696751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.696968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.697233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.697561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.697836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.713588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.716564 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.719818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.722477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.724032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.724280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.724585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.731135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.732753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.735686 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.735970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.736260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.736527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.744682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.744968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.745244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.752057 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:12:54.752338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.752609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.752876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.753233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.753708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.754180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.754548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.754936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.755209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.755654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.756124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.756529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.756809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:12:54.792490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b10f5d99c0 pid: 80191 (default app) Jul 26 07:13:02.273743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676505-db08-467f-942b-f146b44d3054 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:02.274288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676505-db08-467f-942b-f146b44d3054 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:02.274288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676505-db08-467f-942b-f146b44d3054 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:02.275664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:02.284266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:02.284884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:02.284884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:02.356608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: INFO dbcounter [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] Registered counter for database keystone Jul 26 07:13:02.381288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG oslo_db.sqlalchemy.engines [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:13:02.388338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writer thread running {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:13:02.572935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG passlib.handlers.bcrypt [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80191) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 07:13:02.573292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG passlib.handlers.bcrypt [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80191) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 07:13:02.629194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:02.630923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:02.763694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 07:13:02.909319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676505-db08-467f-942b-f146b44d3054 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:02.979553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: INFO dbcounter [None req-46676505-db08-467f-942b-f146b44d3054 None None] Registered counter for database keystone Jul 26 07:13:02.999217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG oslo_db.sqlalchemy.engines [None req-46676505-db08-467f-942b-f146b44d3054 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:13:03.006152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writer thread running {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:13:03.123835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676505-db08-467f-942b-f146b44d3054 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:03.128724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca90b73-fe61-44e2-ab31-03126e775728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:03.129431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90b73-fe61-44e2-ab31-03126e775728 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:03.129774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90b73-fe61-44e2-ab31-03126e775728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:03.130041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90b73-fe61-44e2-ab31-03126e775728 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:03.138873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca90b73-fe61-44e2-ab31-03126e775728 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:03.190763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7ca90b73-fe61-44e2-ab31-03126e775728 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 07:13:03.191091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca90b73-fe61-44e2-ab31-03126e775728 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:03.201964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Jul 26 07:13:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:13:03.208220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:03.224154 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b181c0c-7f0e-4c2d-82ec-c49691ddbd16 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:03.229479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3c78d-36e8-417f-995c-74a184db5bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:03.230639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3c78d-36e8-417f-995c-74a184db5bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:03.230921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3c78d-36e8-417f-995c-74a184db5bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:03.231190 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3c78d-36e8-417f-995c-74a184db5bd5 admin admin] PATH_INFO: `/v3/projects/307d27a777014952aa29c6bcc39dc4ed` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:03.232931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3c78d-36e8-417f-995c-74a184db5bd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=307d27a777014952aa29c6bcc39dc4ed)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:03.283521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fca3c78d-36e8-417f-995c-74a184db5bd5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 07:13:03.283837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3c78d-36e8-417f-995c-74a184db5bd5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:03.288740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 2/5] 10.222.0.20 () {56 vars in 1207 bytes} [Tue Jul 26 07:13:03 2022] GET /identity/v3/projects/307d27a777014952aa29c6bcc39dc4ed => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:05.297818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acc6eb-0172-448b-9784-77badc20887c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:05.298439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acc6eb-0172-448b-9784-77badc20887c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:05.298439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acc6eb-0172-448b-9784-77badc20887c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:05.302639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 4/6] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:05.308804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac72ad3-bf0c-4e67-a985-0a638e337c52 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:05.309355 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac72ad3-bf0c-4e67-a985-0a638e337c52 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:05.309478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac72ad3-bf0c-4e67-a985-0a638e337c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:05.330988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9ac72ad3-bf0c-4e67-a985-0a638e337c52 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:05.332568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9ac72ad3-bf0c-4e67-a985-0a638e337c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:05.341897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 07:13:05.364507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acc6eb-0172-448b-9784-77badc20887c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:05.377571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acc6eb-0172-448b-9784-77badc20887c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:05.382107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a10f-8985-48b0-9dd1-6aaf8c4ee3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:05.382755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a10f-8985-48b0-9dd1-6aaf8c4ee3ca admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:05.383038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a10f-8985-48b0-9dd1-6aaf8c4ee3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:05.383314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a10f-8985-48b0-9dd1-6aaf8c4ee3ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:05.392142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4a10f-8985-48b0-9dd1-6aaf8c4ee3ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:05.393975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4a10f-8985-48b0-9dd1-6aaf8c4ee3ca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:05.403472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Jul 26 07:13:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:13:05.409525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac72ad3-bf0c-4e67-a985-0a638e337c52 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:05.419694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac72ad3-bf0c-4e67-a985-0a638e337c52 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:05.424498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15b27f-0676-4bd2-89d2-a00502fb1b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:05.425183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15b27f-0676-4bd2-89d2-a00502fb1b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:05.425497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15b27f-0676-4bd2-89d2-a00502fb1b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:05.425777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15b27f-0676-4bd2-89d2-a00502fb1b79 admin admin] PATH_INFO: `/v3/users/8e22a2638d8e425c934033b96ce6b062` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:05.427342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15b27f-0676-4bd2-89d2-a00502fb1b79 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e22a2638d8e425c934033b96ce6b062)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:05.429242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15b27f-0676-4bd2-89d2-a00502fb1b79 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:05.430938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 4/9] 10.222.0.20 () {56 vars in 1198 bytes} [Tue Jul 26 07:13:05 2022] GET /identity/v3/users/8e22a2638d8e425c934033b96ce6b062 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:07.508802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8347-fe1e-495a-9637-4a0ea716646f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:07.509355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8347-fe1e-495a-9637-4a0ea716646f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:07.509466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8347-fe1e-495a-9637-4a0ea716646f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:07.510784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:07.516316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3120c94-8304-48aa-b3e1-1867701cc1bb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:07.516767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3120c94-8304-48aa-b3e1-1867701cc1bb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:07.516938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3120c94-8304-48aa-b3e1-1867701cc1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:07.537558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e3120c94-8304-48aa-b3e1-1867701cc1bb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:07.538783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e3120c94-8304-48aa-b3e1-1867701cc1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:07.622830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:07.645652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a8347-fe1e-495a-9637-4a0ea716646f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:07.798790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a8347-fe1e-495a-9637-4a0ea716646f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:07.837837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c41400-86ee-43c5-b104-54623be0de72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:07.838748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c41400-86ee-43c5-b104-54623be0de72 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:07.839033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c41400-86ee-43c5-b104-54623be0de72 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:07.839308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c41400-86ee-43c5-b104-54623be0de72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:07.852997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c41400-86ee-43c5-b104-54623be0de72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-60c41400-86ee-43c5-b104-54623be0de72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:07.862070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:07.868620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:07.869445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 7/12] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:07.870116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3120c94-8304-48aa-b3e1-1867701cc1bb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:07.898300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:07.987689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3120c94-8304-48aa-b3e1-1867701cc1bb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:08.024341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b3c5-8e4b-4f0e-8849-6a7b6da9bc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:08.024996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b3c5-8e4b-4f0e-8849-6a7b6da9bc26 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:08.025298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b3c5-8e4b-4f0e-8849-6a7b6da9bc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:08.025581 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b3c5-8e4b-4f0e-8849-6a7b6da9bc26 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:08.026324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b3c5-8e4b-4f0e-8849-6a7b6da9bc26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:08.026630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b3c5-8e4b-4f0e-8849-6a7b6da9bc26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:08.028057 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b3c5-8e4b-4f0e-8849-6a7b6da9bc26 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:08.040720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 6/13] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:08.046548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c41400-86ee-43c5-b104-54623be0de72 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:08.084571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:08.202129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c41400-86ee-43c5-b104-54623be0de72 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:08.262038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d028-5a2f-4956-9f89-97d11a6e64c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:08.263160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d028-5a2f-4956-9f89-97d11a6e64c8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:08.263586 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d028-5a2f-4956-9f89-97d11a6e64c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:08.264081 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d028-5a2f-4956-9f89-97d11a6e64c8 None admin] PATH_INFO: `/v3/users/8e22a2638d8e425c934033b96ce6b062` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:08.266963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d028-5a2f-4956-9f89-97d11a6e64c8 None admin] RBAC: Authorizing `identity:get_user(user_id=8e22a2638d8e425c934033b96ce6b062)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:08.269767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d028-5a2f-4956-9f89-97d11a6e64c8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:08.272892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 8/14] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:08 2022] GET /identity/v3/users/8e22a2638d8e425c934033b96ce6b062 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:08.281173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b3c5-8e4b-4f0e-8849-6a7b6da9bc26 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:08.375225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:08.392607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b3c5-8e4b-4f0e-8849-6a7b6da9bc26 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:08.428792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2673b9a-3336-4070-9a31-1ef1af92f343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:08.429785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673b9a-3336-4070-9a31-1ef1af92f343 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:08.430167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673b9a-3336-4070-9a31-1ef1af92f343 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:08.430536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673b9a-3336-4070-9a31-1ef1af92f343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:08.432753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2673b9a-3336-4070-9a31-1ef1af92f343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:08.434288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2673b9a-3336-4070-9a31-1ef1af92f343 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:08.435977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 7/15] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:08.442813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d028-5a2f-4956-9f89-97d11a6e64c8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:08.568170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d028-5a2f-4956-9f89-97d11a6e64c8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:08.570071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:08.610989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0f3d2-093f-42e0-864c-70f597d78183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:08.611621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f3d2-093f-42e0-864c-70f597d78183 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:08.611907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f3d2-093f-42e0-864c-70f597d78183 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:08.612172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f3d2-093f-42e0-864c-70f597d78183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:08.612991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0f3d2-093f-42e0-864c-70f597d78183 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.domain.id=default, user.id=8e22a2638d8e425c934033b96ce6b062) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:08.613321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0f3d2-093f-42e0-864c-70f597d78183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:08.614855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0f3d2-093f-42e0-864c-70f597d78183 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:08.624452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 9/16] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Jul 26 07:13:08 2022] GET /identity/v3/role_assignments?user.id=8e22a2638d8e425c934033b96ce6b062&scope.domain.id=default&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 233 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:08.838756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e8d44-a26e-4a7f-8219-7677d308dcac None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:08.839450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e8d44-a26e-4a7f-8219-7677d308dcac None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:08.839450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e8d44-a26e-4a7f-8219-7677d308dcac None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:08.840872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 8/17] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:08.847506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0fc0-36b7-4228-a233-253f264085f1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:08.847970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0fc0-36b7-4228-a233-253f264085f1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:08.848720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0fc0-36b7-4228-a233-253f264085f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:08.868539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-a45d0fc0-36b7-4228-a233-253f264085f1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80192) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 07:13:08.868959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-a45d0fc0-36b7-4228-a233-253f264085f1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80192) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 07:13:08.915165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a45d0fc0-36b7-4228-a233-253f264085f1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:08.916807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a45d0fc0-36b7-4228-a233-253f264085f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:09.015064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:09.036745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e8d44-a26e-4a7f-8219-7677d308dcac None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:09.149487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e8d44-a26e-4a7f-8219-7677d308dcac None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:09.197723 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308242c-dd9f-46cf-872e-4dcae2ab2022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:09.198361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308242c-dd9f-46cf-872e-4dcae2ab2022 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:09.198637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308242c-dd9f-46cf-872e-4dcae2ab2022 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:09.198901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308242c-dd9f-46cf-872e-4dcae2ab2022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:09.226590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:09.275328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308242c-dd9f-46cf-872e-4dcae2ab2022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:09.276834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308242c-dd9f-46cf-872e-4dcae2ab2022 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:09.492793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 9/19] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:09.498589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d0fc0-36b7-4228-a233-253f264085f1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:09.603632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:09.610542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d0fc0-36b7-4228-a233-253f264085f1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:09.648277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d2a2d-1df7-44b0-bae7-89b7c8d897b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:09.649205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2a2d-1df7-44b0-bae7-89b7c8d897b5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:09.649558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2a2d-1df7-44b0-bae7-89b7c8d897b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:09.649831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2a2d-1df7-44b0-bae7-89b7c8d897b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:09.669773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d2a2d-1df7-44b0-bae7-89b7c8d897b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:09.671341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d2a2d-1df7-44b0-bae7-89b7c8d897b5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d29d2a2d-1df7-44b0-bae7-89b7c8d897b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:13:09.687521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:09.688888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:09.690482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:13:09.690482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:13:09.690482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:13:09.690482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:09.690482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:09.694976 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308242c-dd9f-46cf-872e-4dcae2ab2022 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:09.753301 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:09.804951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308242c-dd9f-46cf-872e-4dcae2ab2022 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:09.838966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed462330-413d-45ba-bc3d-5ffc807bfd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:09.839731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462330-413d-45ba-bc3d-5ffc807bfd1f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:09.839897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462330-413d-45ba-bc3d-5ffc807bfd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:09.840170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462330-413d-45ba-bc3d-5ffc807bfd1f None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:09.840871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462330-413d-45ba-bc3d-5ffc807bfd1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:09.841176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462330-413d-45ba-bc3d-5ffc807bfd1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:09.842601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462330-413d-45ba-bc3d-5ffc807bfd1f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:09.860763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:10.645678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850af7f-1b15-40b6-96dc-f390f8bcbe3e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:10.646360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850af7f-1b15-40b6-96dc-f390f8bcbe3e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:10.646598 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850af7f-1b15-40b6-96dc-f390f8bcbe3e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:10.649207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:10.658338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8b6c-fdd9-4743-8f21-40f0317facb8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:10.659003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8b6c-fdd9-4743-8f21-40f0317facb8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:10.659477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8b6c-fdd9-4743-8f21-40f0317facb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:10.686035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-972e8b6c-fdd9-4743-8f21-40f0317facb8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:10.687359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-972e8b6c-fdd9-4743-8f21-40f0317facb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:10.786110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:10.823026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850af7f-1b15-40b6-96dc-f390f8bcbe3e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:10.965433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850af7f-1b15-40b6-96dc-f390f8bcbe3e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:11.012203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7362a-46d0-46c5-89e6-f39143e0ed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:11.012891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7362a-46d0-46c5-89e6-f39143e0ed5c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:11.013177 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7362a-46d0-46c5-89e6-f39143e0ed5c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:11.013472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7362a-46d0-46c5-89e6-f39143e0ed5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:11.029606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7362a-46d0-46c5-89e6-f39143e0ed5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-53d7362a-46d0-46c5-89e6-f39143e0ed5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:11.034857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:11.035832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:11.036623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 13/24] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:11.046476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8b6c-fdd9-4743-8f21-40f0317facb8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:11.125474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:11.200723 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8b6c-fdd9-4743-8f21-40f0317facb8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:11.248712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec018-36ec-494b-8a34-69e27e400e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:11.249334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec018-36ec-494b-8a34-69e27e400e30 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:11.249623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec018-36ec-494b-8a34-69e27e400e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:11.249894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec018-36ec-494b-8a34-69e27e400e30 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:11.250650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec018-36ec-494b-8a34-69e27e400e30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:11.250957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec018-36ec-494b-8a34-69e27e400e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:11.252406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec018-36ec-494b-8a34-69e27e400e30 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:11.265784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 12/25] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:11.272120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7362a-46d0-46c5-89e6-f39143e0ed5c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:11.284435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:11.397894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7362a-46d0-46c5-89e6-f39143e0ed5c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:11.445292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685c794-a02d-4bf5-a8f8-d38666aaa4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:11.445982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685c794-a02d-4bf5-a8f8-d38666aaa4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:11.446264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685c794-a02d-4bf5-a8f8-d38666aaa4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:11.446540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685c794-a02d-4bf5-a8f8-d38666aaa4a9 None admin] PATH_INFO: `/v3/users/8e22a2638d8e425c934033b96ce6b062` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:11.448268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685c794-a02d-4bf5-a8f8-d38666aaa4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=8e22a2638d8e425c934033b96ce6b062)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:11.449825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685c794-a02d-4bf5-a8f8-d38666aaa4a9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:11.451797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 14/26] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:11 2022] GET /identity/v3/users/8e22a2638d8e425c934033b96ce6b062 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:11.458085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec018-36ec-494b-8a34-69e27e400e30 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:11.595051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec018-36ec-494b-8a34-69e27e400e30 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:11.597641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:11.644833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bf3b1-a6b1-4c36-952e-bfbc69519c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:11.645585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf3b1-a6b1-4c36-952e-bfbc69519c25 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:11.645907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf3b1-a6b1-4c36-952e-bfbc69519c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:11.646189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf3b1-a6b1-4c36-952e-bfbc69519c25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:11.647424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bf3b1-a6b1-4c36-952e-bfbc69519c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:11.648902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bf3b1-a6b1-4c36-952e-bfbc69519c25 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:11.650574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 13/27] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:11.656787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685c794-a02d-4bf5-a8f8-d38666aaa4a9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:11.866215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:11.891994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685c794-a02d-4bf5-a8f8-d38666aaa4a9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:11.941179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed7415-8725-428d-ab8f-79dc04d93849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:11.942109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed7415-8725-428d-ab8f-79dc04d93849 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:11.942396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed7415-8725-428d-ab8f-79dc04d93849 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:11.942670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed7415-8725-428d-ab8f-79dc04d93849 None admin] PATH_INFO: `/v3/domains/default/users/8e22a2638d8e425c934033b96ce6b062/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:11.944893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed7415-8725-428d-ab8f-79dc04d93849 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8e22a2638d8e425c934033b96ce6b062, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:11.946444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed7415-8725-428d-ab8f-79dc04d93849 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:12.069934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1361 bytes} [Tue Jul 26 07:13:11 2022] PUT /identity/v3/domains/default/users/8e22a2638d8e425c934033b96ce6b062/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:13:13.038037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b1436-3d44-4c93-98fe-9e3bd8daad6e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.038565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b1436-3d44-4c93-98fe-9e3bd8daad6e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.038565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b1436-3d44-4c93-98fe-9e3bd8daad6e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.039977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 14/29] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:13.051580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9c01c-d5b9-4cb4-811b-df652f7deb1a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.052091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9c01c-d5b9-4cb4-811b-df652f7deb1a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.052165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9c01c-d5b9-4cb4-811b-df652f7deb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.076526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-34c9c01c-d5b9-4cb4-811b-df652f7deb1a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:13.078095 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-34c9c01c-d5b9-4cb4-811b-df652f7deb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:13.102852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951903d6-bc96-4028-9531-b0e292433b33 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.103670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951903d6-bc96-4028-9531-b0e292433b33 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.104144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951903d6-bc96-4028-9531-b0e292433b33 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.106284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:13.120383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75a4e5-ec6b-4c4c-a38b-a2a6e826ff77 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.120986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75a4e5-ec6b-4c4c-a38b-a2a6e826ff77 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.121474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75a4e5-ec6b-4c4c-a38b-a2a6e826ff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.150732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-eb75a4e5-ec6b-4c4c-a38b-a2a6e826ff77 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:13.152306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-eb75a4e5-ec6b-4c4c-a38b-a2a6e826ff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:13.208054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 16/31] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:13.251476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9c01c-d5b9-4cb4-811b-df652f7deb1a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:13.331041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 16/32] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:13.385201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:13.406352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75a4e5-ec6b-4c4c-a38b-a2a6e826ff77 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:13.442870 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9c01c-d5b9-4cb4-811b-df652f7deb1a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:13.502447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fa058-2e84-4686-84b5-bd99e8e6fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:13.503539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa058-2e84-4686-84b5-bd99e8e6fec4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.504037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa058-2e84-4686-84b5-bd99e8e6fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.504552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa058-2e84-4686-84b5-bd99e8e6fec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.534996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fa058-2e84-4686-84b5-bd99e8e6fec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:13.541879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fa058-2e84-4686-84b5-bd99e8e6fec4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-097fa058-2e84-4686-84b5-bd99e8e6fec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:13:13.584350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:13.585220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:13.586064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:13:13.586064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:13:13.586064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:13:13.586064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:13.586782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 17/33] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:13.588574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0bb97-9c58-442b-bb61-ccc28cf14e74 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.589037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0bb97-9c58-442b-bb61-ccc28cf14e74 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.593771 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0bb97-9c58-442b-bb61-ccc28cf14e74 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.606316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 18/34] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:13 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:13.607862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0bb97-9c58-442b-bb61-ccc28cf14e74 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:13.692785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75a4e5-ec6b-4c4c-a38b-a2a6e826ff77 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:13.696695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:13.749709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ab720-e3e0-4083-8b98-e3d54b99de38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:13.750364 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ab720-e3e0-4083-8b98-e3d54b99de38 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.750646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ab720-e3e0-4083-8b98-e3d54b99de38 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.750925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ab720-e3e0-4083-8b98-e3d54b99de38 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.751676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ab720-e3e0-4083-8b98-e3d54b99de38 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:13.753646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ab720-e3e0-4083-8b98-e3d54b99de38 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:13.793152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0bb97-9c58-442b-bb61-ccc28cf14e74 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:13.827863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:13.861961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f3d2b-f47b-4b7d-9dc3-4315df621daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:13.863444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f3d2b-f47b-4b7d-9dc3-4315df621daa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.864202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f3d2b-f47b-4b7d-9dc3-4315df621daa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.864868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f3d2b-f47b-4b7d-9dc3-4315df621daa None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.866559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f3d2b-f47b-4b7d-9dc3-4315df621daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:13.867452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f3d2b-f47b-4b7d-9dc3-4315df621daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:13.870080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f3d2b-f47b-4b7d-9dc3-4315df621daa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:13.902190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 19/35] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:13.904291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 17/36] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 26 07:13:13 2022] POST /identity/v3/roles => generated 219 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:13.904581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bda37-d7f1-49a2-a86f-ef08cf7114b7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.905053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bda37-d7f1-49a2-a86f-ef08cf7114b7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.905551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bda37-d7f1-49a2-a86f-ef08cf7114b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.905895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee262e3-a0aa-447e-a2b3-9e6dddc3bfdf None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.906184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee262e3-a0aa-447e-a2b3-9e6dddc3bfdf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.906467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee262e3-a0aa-447e-a2b3-9e6dddc3bfdf None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.907788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 18/37] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:13.912399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bced16d-4aed-4748-ba0c-32282f1e678f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:13.912399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bced16d-4aed-4748-ba0c-32282f1e678f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:13.912399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bced16d-4aed-4748-ba0c-32282f1e678f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:13.912399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 19/38] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:13.912399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bced16d-4aed-4748-ba0c-32282f1e678f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:13.931763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f40bda37-d7f1-49a2-a86f-ef08cf7114b7 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:13.933438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f40bda37-d7f1-49a2-a86f-ef08cf7114b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:14.029700 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:14.031417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d69563-e95c-43f9-a471-3d119a523275 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:14.031693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d69563-e95c-43f9-a471-3d119a523275 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:14.031976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d69563-e95c-43f9-a471-3d119a523275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:14.039857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bced16d-4aed-4748-ba0c-32282f1e678f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:14.070502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b3d69563-e95c-43f9-a471-3d119a523275 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:14.072065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3d69563-e95c-43f9-a471-3d119a523275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:14.083274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb9c5f-2d2d-4aff-b4e5-f3dc1ae1f194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:14.083929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9c5f-2d2d-4aff-b4e5-f3dc1ae1f194 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:14.084903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9c5f-2d2d-4aff-b4e5-f3dc1ae1f194 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:14.085359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9c5f-2d2d-4aff-b4e5-f3dc1ae1f194 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:14.086677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb9c5f-2d2d-4aff-b4e5-f3dc1ae1f194 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:14.088829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb9c5f-2d2d-4aff-b4e5-f3dc1ae1f194 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:14.135088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:13:13 2022] POST /identity/v3/projects => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:14.136833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5dcf7-e0a6-42a3-b9b6-2f21b3cb7f1c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:14.137389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5dcf7-e0a6-42a3-b9b6-2f21b3cb7f1c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:14.137841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5dcf7-e0a6-42a3-b9b6-2f21b3cb7f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:14.162411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-13d5dcf7-e0a6-42a3-b9b6-2f21b3cb7f1c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:14.165289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-13d5dcf7-e0a6-42a3-b9b6-2f21b3cb7f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:14.182706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:14.193848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:14.194970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d69563-e95c-43f9-a471-3d119a523275 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:14.263823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:14.315123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:14.317047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5dcf7-e0a6-42a3-b9b6-2f21b3cb7f1c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:14.380131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d69563-e95c-43f9-a471-3d119a523275 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:14.429240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eae1d-9b95-4687-a0d2-191876d99693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:14.429863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eae1d-9b95-4687-a0d2-191876d99693 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:14.430147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eae1d-9b95-4687-a0d2-191876d99693 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:14.430429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eae1d-9b95-4687-a0d2-191876d99693 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:14.431594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eae1d-9b95-4687-a0d2-191876d99693 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:14.433054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eae1d-9b95-4687-a0d2-191876d99693 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:14.455002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 26 07:13:14 2022] POST /identity/v3/roles => generated 225 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:14.456245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eae1d-9b95-4687-a0d2-191876d99693 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:14.551669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5dcf7-e0a6-42a3-b9b6-2f21b3cb7f1c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:14.627113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442edf-637c-4cfa-ad7b-1fb785572c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:14.628328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442edf-637c-4cfa-ad7b-1fb785572c33 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:14.628814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442edf-637c-4cfa-ad7b-1fb785572c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:14.629359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442edf-637c-4cfa-ad7b-1fb785572c33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:14.634272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9442edf-637c-4cfa-ad7b-1fb785572c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:14.640791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9442edf-637c-4cfa-ad7b-1fb785572c33 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:14.640791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 22/44] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:14.647559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442edf-637c-4cfa-ad7b-1fb785572c33 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:14.672738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:14.749781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:14.755976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eae1d-9b95-4687-a0d2-191876d99693 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:14.795489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442edf-637c-4cfa-ad7b-1fb785572c33 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:14.829423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43baa1b-a715-4cd7-8152-086745fe6e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:14.830100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43baa1b-a715-4cd7-8152-086745fe6e49 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:14.830378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43baa1b-a715-4cd7-8152-086745fe6e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:14.830657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43baa1b-a715-4cd7-8152-086745fe6e49 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:14.831413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43baa1b-a715-4cd7-8152-086745fe6e49 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:14.832936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43baa1b-a715-4cd7-8152-086745fe6e49 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:14.845160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb41b60-f1ce-46a9-970d-e66c074ae7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:14.846436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb41b60-f1ce-46a9-970d-e66c074ae7b0 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:14.846937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb41b60-f1ce-46a9-970d-e66c074ae7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:14.847415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb41b60-f1ce-46a9-970d-e66c074ae7b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:14.848760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb41b60-f1ce-46a9-970d-e66c074ae7b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:14.851092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 26 07:13:14 2022] POST /identity/v3/roles => generated 223 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:14.851572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb41b60-f1ce-46a9-970d-e66c074ae7b0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:14.904664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:13:14 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:15.123462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a147fa6-8eb4-484c-815a-44d84dc31da8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:15.124009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a147fa6-8eb4-484c-815a-44d84dc31da8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:15.124009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a147fa6-8eb4-484c-815a-44d84dc31da8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:15.125335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:15.131187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645e002-da10-4910-b87e-ddf85c905c01 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:15.131737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645e002-da10-4910-b87e-ddf85c905c01 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:15.131737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645e002-da10-4910-b87e-ddf85c905c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:15.151531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8645e002-da10-4910-b87e-ddf85c905c01 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:15.152792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8645e002-da10-4910-b87e-ddf85c905c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:15.229181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:15.241968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:15.264558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a147fa6-8eb4-484c-815a-44d84dc31da8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:15.373842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a147fa6-8eb4-484c-815a-44d84dc31da8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:15.410973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cef26-318d-4ad7-be60-58e23a048c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:15.411642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cef26-318d-4ad7-be60-58e23a048c6b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:15.411927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cef26-318d-4ad7-be60-58e23a048c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:15.412211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cef26-318d-4ad7-be60-58e23a048c6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:15.423807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cef26-318d-4ad7-be60-58e23a048c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cf0cef26-318d-4ad7-be60-58e23a048c6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:15.429514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:15.430448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:15.431767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:15.436795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645e002-da10-4910-b87e-ddf85c905c01 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:15.542025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645e002-da10-4910-b87e-ddf85c905c01 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:15.582919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305df2-4f7f-46a9-8b59-13fd74534f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:15.583564 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305df2-4f7f-46a9-8b59-13fd74534f5c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:15.583844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305df2-4f7f-46a9-8b59-13fd74534f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:15.584113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305df2-4f7f-46a9-8b59-13fd74534f5c None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:15.584850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea305df2-4f7f-46a9-8b59-13fd74534f5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:15.585153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea305df2-4f7f-46a9-8b59-13fd74534f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:15.586598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea305df2-4f7f-46a9-8b59-13fd74534f5c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:15.595888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 25/50] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:15.601723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cef26-318d-4ad7-be60-58e23a048c6b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:15.623168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:15.712167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cef26-318d-4ad7-be60-58e23a048c6b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:15.749504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2f0dc-eb06-4d03-b261-3e3f72560a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:15.750363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2f0dc-eb06-4d03-b261-3e3f72560a51 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:15.750643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2f0dc-eb06-4d03-b261-3e3f72560a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:15.750917 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2f0dc-eb06-4d03-b261-3e3f72560a51 None admin] PATH_INFO: `/v3/users/8e22a2638d8e425c934033b96ce6b062` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:15.752136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2f0dc-eb06-4d03-b261-3e3f72560a51 None admin] RBAC: Authorizing `identity:get_user(user_id=8e22a2638d8e425c934033b96ce6b062)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:15.753637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2f0dc-eb06-4d03-b261-3e3f72560a51 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:15.755310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 26/51] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:15 2022] GET /identity/v3/users/8e22a2638d8e425c934033b96ce6b062 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:15.761074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305df2-4f7f-46a9-8b59-13fd74534f5c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:15.854139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:15.931788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305df2-4f7f-46a9-8b59-13fd74534f5c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:15.990740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f083-d9ce-49d8-844f-bc34e9843780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:15.991766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f083-d9ce-49d8-844f-bc34e9843780 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:15.992152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f083-d9ce-49d8-844f-bc34e9843780 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:15.992668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f083-d9ce-49d8-844f-bc34e9843780 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:15.994808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f083-d9ce-49d8-844f-bc34e9843780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:15.997480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f083-d9ce-49d8-844f-bc34e9843780 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:16.000517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 26/52] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:16.010055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2f0dc-eb06-4d03-b261-3e3f72560a51 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:16.142836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:16.159363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2f0dc-eb06-4d03-b261-3e3f72560a51 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:16.195448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c74bc-eff6-49c6-84d4-40b7b77a5358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:16.196074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c74bc-eff6-49c6-84d4-40b7b77a5358 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:16.196360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c74bc-eff6-49c6-84d4-40b7b77a5358 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:16.196637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c74bc-eff6-49c6-84d4-40b7b77a5358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:16.197483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c74bc-eff6-49c6-84d4-40b7b77a5358 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.domain.id=default, user.id=8e22a2638d8e425c934033b96ce6b062) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:16.197794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c74bc-eff6-49c6-84d4-40b7b77a5358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:16.199315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c74bc-eff6-49c6-84d4-40b7b77a5358 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:16.206198 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Jul 26 07:13:16 2022] GET /identity/v3/role_assignments?user.id=8e22a2638d8e425c934033b96ce6b062&scope.domain.id=default&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 530 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:17.589496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430cbf4-5d1f-4a0f-844b-2b06d228a5e3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:17.590039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430cbf4-5d1f-4a0f-844b-2b06d228a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:17.590039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430cbf4-5d1f-4a0f-844b-2b06d228a5e3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:17.591426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 27/54] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:17.597376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e2e7e-2cc8-4534-b142-1f58ad1364e1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:17.597816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e2e7e-2cc8-4534-b142-1f58ad1364e1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:17.597925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e2e7e-2cc8-4534-b142-1f58ad1364e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:17.616583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8f3e2e7e-2cc8-4534-b142-1f58ad1364e1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:17.617845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8f3e2e7e-2cc8-4534-b142-1f58ad1364e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:17.688214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 28/55] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:17.713000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430cbf4-5d1f-4a0f-844b-2b06d228a5e3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:17.849112 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430cbf4-5d1f-4a0f-844b-2b06d228a5e3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:17.876576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:17.888816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cceb87b-de03-43ba-8ffa-d7a9f27076dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:17.889510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cceb87b-de03-43ba-8ffa-d7a9f27076dd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:17.889779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cceb87b-de03-43ba-8ffa-d7a9f27076dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:17.890052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cceb87b-de03-43ba-8ffa-d7a9f27076dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:17.891252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cceb87b-de03-43ba-8ffa-d7a9f27076dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:17.892742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cceb87b-de03-43ba-8ffa-d7a9f27076dd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:17.894442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 28/56] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:17.901015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e2e7e-2cc8-4534-b142-1f58ad1364e1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:17.995032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:18.015571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e2e7e-2cc8-4534-b142-1f58ad1364e1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:18.053338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611253f0-4230-48cc-8ad2-1408628888b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:18.053977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611253f0-4230-48cc-8ad2-1408628888b1 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:18.054265 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611253f0-4230-48cc-8ad2-1408628888b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:18.054539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611253f0-4230-48cc-8ad2-1408628888b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:18.055246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611253f0-4230-48cc-8ad2-1408628888b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:18.056749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611253f0-4230-48cc-8ad2-1408628888b1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:18.090245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 29/57] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Jul 26 07:13:17 2022] POST /identity/v3/projects => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:20.096191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eb121-a249-4de3-9243-778e752d1522 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:20.096747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eb121-a249-4de3-9243-778e752d1522 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:20.096747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eb121-a249-4de3-9243-778e752d1522 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:20.098202 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:20.104182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef564983-a81f-4cd5-9e45-0ed15f373e01 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:20.104670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef564983-a81f-4cd5-9e45-0ed15f373e01 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:20.104755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef564983-a81f-4cd5-9e45-0ed15f373e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:20.125221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ef564983-a81f-4cd5-9e45-0ed15f373e01 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:20.126495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ef564983-a81f-4cd5-9e45-0ed15f373e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:20.202975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:20.228638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eb121-a249-4de3-9243-778e752d1522 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:20.353931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eb121-a249-4de3-9243-778e752d1522 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:20.395778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18827a5f-562f-4386-8b85-aaeaf85ce4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:20.396442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18827a5f-562f-4386-8b85-aaeaf85ce4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:20.396722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18827a5f-562f-4386-8b85-aaeaf85ce4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:20.396993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18827a5f-562f-4386-8b85-aaeaf85ce4f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:20.398248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18827a5f-562f-4386-8b85-aaeaf85ce4f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:20.399711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18827a5f-562f-4386-8b85-aaeaf85ce4f8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:20.401356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:20.407552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef564983-a81f-4cd5-9e45-0ed15f373e01 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:20.472041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:20.512784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef564983-a81f-4cd5-9e45-0ed15f373e01 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:20.550001 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba0ceb-1eb7-437f-96d9-5e06238311a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:20.550632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0ceb-1eb7-437f-96d9-5e06238311a7 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:20.550911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0ceb-1eb7-437f-96d9-5e06238311a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:20.551225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0ceb-1eb7-437f-96d9-5e06238311a7 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:20.551923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba0ceb-1eb7-437f-96d9-5e06238311a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:20.553428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba0ceb-1eb7-437f-96d9-5e06238311a7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:20.581992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:13:20 2022] POST /identity/v3/users => generated 275 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:24.008278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d46a2c-6c87-47d5-94f8-f067190afbc6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.008278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d46a2c-6c87-47d5-94f8-f067190afbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.008278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d46a2c-6c87-47d5-94f8-f067190afbc6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.008278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:24.014667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddd6b1-3e0e-448a-86d8-b73f7552fc72 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.015140 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddd6b1-3e0e-448a-86d8-b73f7552fc72 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.015237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddd6b1-3e0e-448a-86d8-b73f7552fc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.034831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58861889-e378-41d5-83b9-a4377844c86f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.035571 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58861889-e378-41d5-83b9-a4377844c86f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.036040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58861889-e378-41d5-83b9-a4377844c86f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.037742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:24.042657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-baddd6b1-3e0e-448a-86d8-b73f7552fc72 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:24.044214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-baddd6b1-3e0e-448a-86d8-b73f7552fc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:24.046700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5bb6e-26a8-4aca-b83f-04a63abeaf99 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.047246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5bb6e-26a8-4aca-b83f-04a63abeaf99 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.047734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5bb6e-26a8-4aca-b83f-04a63abeaf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.071716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f6c5bb6e-26a8-4aca-b83f-04a63abeaf99 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:24.073566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f6c5bb6e-26a8-4aca-b83f-04a63abeaf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:24.124987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:24.126725 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1de56-32fb-4fad-b70e-487088c8df8f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.127072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1de56-32fb-4fad-b70e-487088c8df8f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.127410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1de56-32fb-4fad-b70e-487088c8df8f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.128993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 33/65] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:24.141565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b290f-a4a4-4eff-a19b-48864824b009 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.142085 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b290f-a4a4-4eff-a19b-48864824b009 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.142567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b290f-a4a4-4eff-a19b-48864824b009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.169655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a47b290f-a4a4-4eff-a19b-48864824b009 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:24.170870 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a47b290f-a4a4-4eff-a19b-48864824b009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:24.182143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:24.207672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 33/66] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:24.209077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5bb6e-26a8-4aca-b83f-04a63abeaf99 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:24.245121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:24.276961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 34/67] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:24.285694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b290f-a4a4-4eff-a19b-48864824b009 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:24.356423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5bb6e-26a8-4aca-b83f-04a63abeaf99 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:24.396488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35f521-8f4f-4f46-8dda-e87c4f6b81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:24.397530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35f521-8f4f-4f46-8dda-e87c4f6b81e8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.398020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35f521-8f4f-4f46-8dda-e87c4f6b81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.398478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35f521-8f4f-4f46-8dda-e87c4f6b81e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.411753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35f521-8f4f-4f46-8dda-e87c4f6b81e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:24.414773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b290f-a4a4-4eff-a19b-48864824b009 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-eb35f521-8f4f-4f46-8dda-e87c4f6b81e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:24.421246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:24.422252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:24.423078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 34/68] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:24.423761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35f521-8f4f-4f46-8dda-e87c4f6b81e8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:24.456480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522cbbe-94f0-4db4-b04d-addddee214d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:24.457543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522cbbe-94f0-4db4-b04d-addddee214d5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.457989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522cbbe-94f0-4db4-b04d-addddee214d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.458417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522cbbe-94f0-4db4-b04d-addddee214d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.471279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522cbbe-94f0-4db4-b04d-addddee214d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8522cbbe-94f0-4db4-b04d-addddee214d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:24.476908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:24.478064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:24.478962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:24.480897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:13:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:24.481995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522cbbe-94f0-4db4-b04d-addddee214d5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:24.484827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:24.538742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:24.559091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35f521-8f4f-4f46-8dda-e87c4f6b81e8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:24.615615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d8738-4bc0-47e9-a1fc-aba70a152587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:24.616680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d8738-4bc0-47e9-a1fc-aba70a152587 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.617307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d8738-4bc0-47e9-a1fc-aba70a152587 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.617836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d8738-4bc0-47e9-a1fc-aba70a152587 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.628625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522cbbe-94f0-4db4-b04d-addddee214d5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:24.632286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d8738-4bc0-47e9-a1fc-aba70a152587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-304d8738-4bc0-47e9-a1fc-aba70a152587 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:24.639497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:24.640580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:24.641502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 35/70] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:13:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:24.642388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d8738-4bc0-47e9-a1fc-aba70a152587 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:24.679143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26160481-a84c-492d-89eb-da990fa715d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:24.681773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26160481-a84c-492d-89eb-da990fa715d9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.682461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26160481-a84c-492d-89eb-da990fa715d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.683167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26160481-a84c-492d-89eb-da990fa715d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.685664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26160481-a84c-492d-89eb-da990fa715d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:24.685995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26160481-a84c-492d-89eb-da990fa715d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:24.687456 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26160481-a84c-492d-89eb-da990fa715d9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:24.700548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:24.701462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26160481-a84c-492d-89eb-da990fa715d9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:24.763025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d8738-4bc0-47e9-a1fc-aba70a152587 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:24.776068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:24.801929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6dab-e81a-4a48-b625-21d7ecfce38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:24.802574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6dab-e81a-4a48-b625-21d7ecfce38a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.802857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6dab-e81a-4a48-b625-21d7ecfce38a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.803127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6dab-e81a-4a48-b625-21d7ecfce38a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.803859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b6dab-e81a-4a48-b625-21d7ecfce38a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:24.804161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b6dab-e81a-4a48-b625-21d7ecfce38a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:24.805602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b6dab-e81a-4a48-b625-21d7ecfce38a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:24.809919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:24.813146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26160481-a84c-492d-89eb-da990fa715d9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:24.815131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 36/72] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:24.816947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128709c-5fc4-4ad4-958b-250fa3c4fd16 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.817235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128709c-5fc4-4ad4-958b-250fa3c4fd16 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.818180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128709c-5fc4-4ad4-958b-250fa3c4fd16 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.819799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 37/73] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:24.821072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21e450-a5d0-42e1-a2c4-eaf197b10556 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.821376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21e450-a5d0-42e1-a2c4-eaf197b10556 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.821650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21e450-a5d0-42e1-a2c4-eaf197b10556 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.822887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 38/74] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:24.826092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21e450-a5d0-42e1-a2c4-eaf197b10556 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:24.855243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b602c9-8aa3-4fd3-9525-2da4c5e7c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:24.855888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b602c9-8aa3-4fd3-9525-2da4c5e7c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.856168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b602c9-8aa3-4fd3-9525-2da4c5e7c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.856477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b602c9-8aa3-4fd3-9525-2da4c5e7c4d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:24.857187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b602c9-8aa3-4fd3-9525-2da4c5e7c4d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:24.857528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b602c9-8aa3-4fd3-9525-2da4c5e7c4d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:24.858929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b602c9-8aa3-4fd3-9525-2da4c5e7c4d5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:24.867742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:13:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:24.868596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b602c9-8aa3-4fd3-9525-2da4c5e7c4d5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:24.949165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21e450-a5d0-42e1-a2c4-eaf197b10556 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:24.992222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76120594-014a-4914-ad02-02c5cc216dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:24.993055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76120594-014a-4914-ad02-02c5cc216dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:24.993371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76120594-014a-4914-ad02-02c5cc216dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:24.993765 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76120594-014a-4914-ad02-02c5cc216dd7 None admin] PATH_INFO: `/v3/users/66d89ddc6ddc4301a34002851e393306` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.011939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76120594-014a-4914-ad02-02c5cc216dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=66d89ddc6ddc4301a34002851e393306)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:25.014921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76120594-014a-4914-ad02-02c5cc216dd7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:25.017036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b602c9-8aa3-4fd3-9525-2da4c5e7c4d5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:25.017541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 39/76] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:24 2022] GET /identity/v3/users/66d89ddc6ddc4301a34002851e393306 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:25.019674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db42ff-c5fb-4b72-b81b-e8b48bf2355f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:25.020218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db42ff-c5fb-4b72-b81b-e8b48bf2355f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:25.021251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db42ff-c5fb-4b72-b81b-e8b48bf2355f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.048321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-84db42ff-c5fb-4b72-b81b-e8b48bf2355f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:25.049753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-84db42ff-c5fb-4b72-b81b-e8b48bf2355f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:25.061925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72484839-9bb3-4a56-87bf-f505387093e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:25.062522 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72484839-9bb3-4a56-87bf-f505387093e7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:25.062827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72484839-9bb3-4a56-87bf-f505387093e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:25.063107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72484839-9bb3-4a56-87bf-f505387093e7 None admin] PATH_INFO: `/v3/users/8e22a2638d8e425c934033b96ce6b062` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.064333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72484839-9bb3-4a56-87bf-f505387093e7 None admin] RBAC: Authorizing `identity:get_user(user_id=8e22a2638d8e425c934033b96ce6b062)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:25.065879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72484839-9bb3-4a56-87bf-f505387093e7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:25.067749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 38/77] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:24 2022] GET /identity/v3/users/8e22a2638d8e425c934033b96ce6b062 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:25.068919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80699-f898-4f62-8f9c-d67ad4c91dac None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:25.069183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80699-f898-4f62-8f9c-d67ad4c91dac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:25.069491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80699-f898-4f62-8f9c-d67ad4c91dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.083879 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:25.088285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5ae80699-f898-4f62-8f9c-d67ad4c91dac None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:25.089670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5ae80699-f898-4f62-8f9c-d67ad4c91dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:25.118905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:25.144607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 40/78] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:25.145576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db42ff-c5fb-4b72-b81b-e8b48bf2355f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:25.172504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 39/79] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:25.173493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80699-f898-4f62-8f9c-d67ad4c91dac None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:25.261274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db42ff-c5fb-4b72-b81b-e8b48bf2355f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:25.300177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6c886-93e1-4fc8-b528-d9ecea6989df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:25.301787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6c886-93e1-4fc8-b528-d9ecea6989df None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:25.302106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6c886-93e1-4fc8-b528-d9ecea6989df None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:25.302594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6c886-93e1-4fc8-b528-d9ecea6989df None admin] PATH_INFO: `/v3/users/66d89ddc6ddc4301a34002851e393306` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.304715 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6c886-93e1-4fc8-b528-d9ecea6989df None admin] RBAC: Authorizing `identity:get_user(user_id=66d89ddc6ddc4301a34002851e393306)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:25.306497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6c886-93e1-4fc8-b528-d9ecea6989df None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:25.308296 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 41/80] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:25 2022] GET /identity/v3/users/66d89ddc6ddc4301a34002851e393306 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:25.308690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80699-f898-4f62-8f9c-d67ad4c91dac None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:25.309123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6c886-93e1-4fc8-b528-d9ecea6989df None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:25.340974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:25.365825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823780d9-648d-43f0-acb3-ed99aeb3ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:25.366470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823780d9-648d-43f0-acb3-ed99aeb3ff59 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:25.366752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823780d9-648d-43f0-acb3-ed99aeb3ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:25.367035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823780d9-648d-43f0-acb3-ed99aeb3ff59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.399799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:25.433321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6c886-93e1-4fc8-b528-d9ecea6989df None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:25.445524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823780d9-648d-43f0-acb3-ed99aeb3ff59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:25.447037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823780d9-648d-43f0-acb3-ed99aeb3ff59 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:25.471048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03793f9-7dd6-4a6a-8c34-700dd0e7a948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:25.471684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03793f9-7dd6-4a6a-8c34-700dd0e7a948 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:25.471964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03793f9-7dd6-4a6a-8c34-700dd0e7a948 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:25.472235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03793f9-7dd6-4a6a-8c34-700dd0e7a948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.543070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03793f9-7dd6-4a6a-8c34-700dd0e7a948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:25.544639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03793f9-7dd6-4a6a-8c34-700dd0e7a948 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:25.562968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 40/81] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:25.563853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823780d9-648d-43f0-acb3-ed99aeb3ff59 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:25.580573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:25.628195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:25.661648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 42/82] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:25.662541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03793f9-7dd6-4a6a-8c34-700dd0e7a948 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:25.681830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823780d9-648d-43f0-acb3-ed99aeb3ff59 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:25.730150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d5014-4d73-4e5e-8d06-8fb08d8a4615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:25.730798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d5014-4d73-4e5e-8d06-8fb08d8a4615 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:25.731082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d5014-4d73-4e5e-8d06-8fb08d8a4615 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:25.731355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d5014-4d73-4e5e-8d06-8fb08d8a4615 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.732543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d5014-4d73-4e5e-8d06-8fb08d8a4615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:25.734056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d5014-4d73-4e5e-8d06-8fb08d8a4615 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:25.735707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 41/83] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:25.740466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d5014-4d73-4e5e-8d06-8fb08d8a4615 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:25.790002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03793f9-7dd6-4a6a-8c34-700dd0e7a948 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:25.820935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:25.829856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cd683-e22b-4ded-87cc-77e9eaa00864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:25.830523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cd683-e22b-4ded-87cc-77e9eaa00864 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:25.830836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cd683-e22b-4ded-87cc-77e9eaa00864 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:25.831088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cd683-e22b-4ded-87cc-77e9eaa00864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.841922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cd683-e22b-4ded-87cc-77e9eaa00864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-567cd683-e22b-4ded-87cc-77e9eaa00864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:25.847334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:25.848462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:25.849246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 43/84] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:25.849934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cd683-e22b-4ded-87cc-77e9eaa00864 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:25.856945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d5014-4d73-4e5e-8d06-8fb08d8a4615 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:25.890328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:25.900179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9a46b-aeb0-4a50-ae88-68a5e6aaeb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:25.900837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a46b-aeb0-4a50-ae88-68a5e6aaeb37 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:25.901113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a46b-aeb0-4a50-ae88-68a5e6aaeb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:25.901425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a46b-aeb0-4a50-ae88-68a5e6aaeb37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:25.972583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cd683-e22b-4ded-87cc-77e9eaa00864 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:25.979295 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9a46b-aeb0-4a50-ae88-68a5e6aaeb37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:25.980808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9a46b-aeb0-4a50-ae88-68a5e6aaeb37 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.012144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f7b5-927d-4471-a5e6-2c72ac16188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.012831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f7b5-927d-4471-a5e6-2c72ac16188f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.013109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f7b5-927d-4471-a5e6-2c72ac16188f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.013423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f7b5-927d-4471-a5e6-2c72ac16188f None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.014750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f7b5-927d-4471-a5e6-2c72ac16188f None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:26.016237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f7b5-927d-4471-a5e6-2c72ac16188f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.018042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 44/85] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:25 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:26.018862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f7b5-927d-4471-a5e6-2c72ac16188f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:26.084906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:26.099714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 42/86] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:26.100676 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9a46b-aeb0-4a50-ae88-68a5e6aaeb37 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:26.133096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:26.137284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f7b5-927d-4471-a5e6-2c72ac16188f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:26.175380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d146-15d8-4784-a1e7-90c56b35d715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.175941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d146-15d8-4784-a1e7-90c56b35d715 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.176377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d146-15d8-4784-a1e7-90c56b35d715 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.176660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d146-15d8-4784-a1e7-90c56b35d715 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.177928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6d146-15d8-4784-a1e7-90c56b35d715 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:26.179413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6d146-15d8-4784-a1e7-90c56b35d715 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.181163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 45/87] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:26 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:26.181980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d146-15d8-4784-a1e7-90c56b35d715 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:26.213881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9a46b-aeb0-4a50-ae88-68a5e6aaeb37 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:26.251103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6703f-f82a-48b1-993c-c3a3de35d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.251744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6703f-f82a-48b1-993c-c3a3de35d99e None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.252037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6703f-f82a-48b1-993c-c3a3de35d99e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.252308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6703f-f82a-48b1-993c-c3a3de35d99e None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.253026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6703f-f82a-48b1-993c-c3a3de35d99e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:26.254534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6703f-f82a-48b1-993c-c3a3de35d99e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.278586 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 43/88] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:13:26 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:26.279472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6703f-f82a-48b1-993c-c3a3de35d99e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:26.300059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d146-15d8-4784-a1e7-90c56b35d715 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:26.339616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:26.353862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c17c8f-953c-4088-8c14-ebed9c5f61db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.355068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c17c8f-953c-4088-8c14-ebed9c5f61db None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.355068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c17c8f-953c-4088-8c14-ebed9c5f61db None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.355267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c17c8f-953c-4088-8c14-ebed9c5f61db None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.355995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c17c8f-953c-4088-8c14-ebed9c5f61db None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:26.356313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c17c8f-953c-4088-8c14-ebed9c5f61db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:26.357908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c17c8f-953c-4088-8c14-ebed9c5f61db None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.369315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 46/89] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:26.369823 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c17c8f-953c-4088-8c14-ebed9c5f61db None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:26.393307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:26.412963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6703f-f82a-48b1-993c-c3a3de35d99e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:26.461639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b3bc5-094f-423b-9a4e-0822cc3c1d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.461639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b3bc5-094f-423b-9a4e-0822cc3c1d66 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.461928 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b3bc5-094f-423b-9a4e-0822cc3c1d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.462181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b3bc5-094f-423b-9a4e-0822cc3c1d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.463504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b3bc5-094f-423b-9a4e-0822cc3c1d66 None admin] RBAC: Adding query filter params (role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=8096b1508e644200a9a730939b83c252, user.id=66d89ddc6ddc4301a34002851e393306) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:26.463504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b3bc5-094f-423b-9a4e-0822cc3c1d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:26.465164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b3bc5-094f-423b-9a4e-0822cc3c1d66 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.473154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 44/90] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:26 2022] GET /identity/v3/role_assignments?user.id=66d89ddc6ddc4301a34002851e393306&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:26.474119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b3bc5-094f-423b-9a4e-0822cc3c1d66 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:26.520544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c17c8f-953c-4088-8c14-ebed9c5f61db None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:26.575059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39facecc-145c-447e-b273-b5b086bf0573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.575754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39facecc-145c-447e-b273-b5b086bf0573 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.576040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39facecc-145c-447e-b273-b5b086bf0573 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.576628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39facecc-145c-447e-b273-b5b086bf0573 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.579141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39facecc-145c-447e-b273-b5b086bf0573 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:26.580678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39facecc-145c-447e-b273-b5b086bf0573 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.588469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 47/91] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:26 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:26.589662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39facecc-145c-447e-b273-b5b086bf0573 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:26.626038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b3bc5-094f-423b-9a4e-0822cc3c1d66 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:26.683280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730afc-74d1-4e03-b982-9b7668317c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.683952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730afc-74d1-4e03-b982-9b7668317c4e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.684233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730afc-74d1-4e03-b982-9b7668317c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.684505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730afc-74d1-4e03-b982-9b7668317c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.685402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b730afc-74d1-4e03-b982-9b7668317c4e None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=8096b1508e644200a9a730939b83c252, user.id=8e22a2638d8e425c934033b96ce6b062) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:26.685742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b730afc-74d1-4e03-b982-9b7668317c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:26.687256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b730afc-74d1-4e03-b982-9b7668317c4e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.692668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:26.705294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 45/92] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:26 2022] GET /identity/v3/role_assignments?user.id=8e22a2638d8e425c934033b96ce6b062&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:26.705294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730afc-74d1-4e03-b982-9b7668317c4e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:26.737082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:26.755496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39facecc-145c-447e-b273-b5b086bf0573 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:26.799679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95732223-22f7-49df-a460-b6d46630f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.800415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95732223-22f7-49df-a460-b6d46630f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.800845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95732223-22f7-49df-a460-b6d46630f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.801374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95732223-22f7-49df-a460-b6d46630f3d2 None admin] PATH_INFO: `/v3/users/66d89ddc6ddc4301a34002851e393306` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.802771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95732223-22f7-49df-a460-b6d46630f3d2 None admin] RBAC: Authorizing `identity:get_user(user_id=66d89ddc6ddc4301a34002851e393306)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:26.804262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95732223-22f7-49df-a460-b6d46630f3d2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.806778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 48/93] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:26 2022] GET /identity/v3/users/66d89ddc6ddc4301a34002851e393306 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:26.814158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95732223-22f7-49df-a460-b6d46630f3d2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:26.851515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730afc-74d1-4e03-b982-9b7668317c4e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:26.915758 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e49cb1-5ec2-4f52-b7fd-76d243a6cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.916655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e49cb1-5ec2-4f52-b7fd-76d243a6cdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.916939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e49cb1-5ec2-4f52-b7fd-76d243a6cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.917214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e49cb1-5ec2-4f52-b7fd-76d243a6cdc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.918459 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e49cb1-5ec2-4f52-b7fd-76d243a6cdc1 None admin] RBAC: Adding query filter params (role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=8096b1508e644200a9a730939b83c252, user.id=66d89ddc6ddc4301a34002851e393306) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:26.918793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e49cb1-5ec2-4f52-b7fd-76d243a6cdc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:26.920307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e49cb1-5ec2-4f52-b7fd-76d243a6cdc1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:26.933754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 46/94] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:26 2022] GET /identity/v3/role_assignments?user.id=66d89ddc6ddc4301a34002851e393306&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:26.949606 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95732223-22f7-49df-a460-b6d46630f3d2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:26.988383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416caac7-a926-430b-a213-422cee5953ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:26.989051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416caac7-a926-430b-a213-422cee5953ee None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:26.989371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416caac7-a926-430b-a213-422cee5953ee None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:26.989657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416caac7-a926-430b-a213-422cee5953ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:26.994512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:27.070668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416caac7-a926-430b-a213-422cee5953ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:27.072234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416caac7-a926-430b-a213-422cee5953ee None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:27.184773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 49/95] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:27.194490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e49cb1-5ec2-4f52-b7fd-76d243a6cdc1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:27.321755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:27.339250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e49cb1-5ec2-4f52-b7fd-76d243a6cdc1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:27.378208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd904-4e14-4344-b253-cb7c3684bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:27.378880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd904-4e14-4344-b253-cb7c3684bc50 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:27.379223 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd904-4e14-4344-b253-cb7c3684bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:27.379564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd904-4e14-4344-b253-cb7c3684bc50 None admin] PATH_INFO: `/v3/projects/00484a9e74f749539691ebeec5f67597` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:27.380792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffd904-4e14-4344-b253-cb7c3684bc50 None admin] RBAC: Authorizing `identity:get_project(project_id=00484a9e74f749539691ebeec5f67597)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:27.382289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffd904-4e14-4344-b253-cb7c3684bc50 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:27.384033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 47/96] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:27 2022] GET /identity/v3/projects/00484a9e74f749539691ebeec5f67597 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:27.390161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416caac7-a926-430b-a213-422cee5953ee None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:27.418428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:27.509729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416caac7-a926-430b-a213-422cee5953ee None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:27.556625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cc320-937d-41ac-b7f8-e90d47cc207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:27.557290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cc320-937d-41ac-b7f8-e90d47cc207e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:27.557590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cc320-937d-41ac-b7f8-e90d47cc207e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:27.557856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cc320-937d-41ac-b7f8-e90d47cc207e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:27.558681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cc320-937d-41ac-b7f8-e90d47cc207e None admin] RBAC: Adding query filter params (role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=00484a9e74f749539691ebeec5f67597, user.id=66d89ddc6ddc4301a34002851e393306) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:27.558980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cc320-937d-41ac-b7f8-e90d47cc207e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:27.560464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cc320-937d-41ac-b7f8-e90d47cc207e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:27.571221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 50/97] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:27 2022] GET /identity/v3/role_assignments?user.id=66d89ddc6ddc4301a34002851e393306&scope.project.id=00484a9e74f749539691ebeec5f67597&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:29.310421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e44b-cbd8-40d0-a03e-b99ab7072a6d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:29.310971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e44b-cbd8-40d0-a03e-b99ab7072a6d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:29.310971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e44b-cbd8-40d0-a03e-b99ab7072a6d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:29.312769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 48/98] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:29.318104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b405d-4947-424c-b5d4-104275ed8d7c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:29.318552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b405d-4947-424c-b5d4-104275ed8d7c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:29.318650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b405d-4947-424c-b5d4-104275ed8d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:29.341777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f78b405d-4947-424c-b5d4-104275ed8d7c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:29.343014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f78b405d-4947-424c-b5d4-104275ed8d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:29.429773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 51/99] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:29.473327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7e44b-cbd8-40d0-a03e-b99ab7072a6d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:29.602088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7e44b-cbd8-40d0-a03e-b99ab7072a6d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:29.650956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891e683-f410-461f-9d13-40f2a4a2c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:29.651635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891e683-f410-461f-9d13-40f2a4a2c1de None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:29.651923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891e683-f410-461f-9d13-40f2a4a2c1de None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:29.652204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891e683-f410-461f-9d13-40f2a4a2c1de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:29.677585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891e683-f410-461f-9d13-40f2a4a2c1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5891e683-f410-461f-9d13-40f2a4a2c1de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:29.683179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:29.684067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:29.684862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 49/100] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:29.692246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b405d-4947-424c-b5d4-104275ed8d7c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:29.728128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:29.841870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b405d-4947-424c-b5d4-104275ed8d7c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:29.871604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cc260-8ac5-4da6-a534-874945dc1ed1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:29.872195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cc260-8ac5-4da6-a534-874945dc1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:29.872689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cc260-8ac5-4da6-a534-874945dc1ed1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:29.874347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 50/101] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:29.880329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5adf-ab48-4c63-9e32-21b835eb0678 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:29.881008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5adf-ab48-4c63-9e32-21b835eb0678 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:29.881526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5adf-ab48-4c63-9e32-21b835eb0678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:29.890847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:29.900332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283d18-e723-4905-977a-c4db967c4019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:29.900984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283d18-e723-4905-977a-c4db967c4019 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:29.901285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283d18-e723-4905-977a-c4db967c4019 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:29.901559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283d18-e723-4905-977a-c4db967c4019 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:29.902293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6283d18-e723-4905-977a-c4db967c4019 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:29.902596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6283d18-e723-4905-977a-c4db967c4019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:29.903996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6283d18-e723-4905-977a-c4db967c4019 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:29.905853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d37e5adf-ab48-4c63-9e32-21b835eb0678 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:29.907300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d37e5adf-ab48-4c63-9e32-21b835eb0678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:29.920927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 52/102] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:29.929741 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283d18-e723-4905-977a-c4db967c4019 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:30.028872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 51/103] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:30.030236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f05658-70cd-474f-9084-6086503cc969 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.030523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f05658-70cd-474f-9084-6086503cc969 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.030806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f05658-70cd-474f-9084-6086503cc969 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.032268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 52/104] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:30.037882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553f48b-26ad-4cc3-a169-9f543c4d69d5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.038170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553f48b-26ad-4cc3-a169-9f543c4d69d5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.038444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553f48b-26ad-4cc3-a169-9f543c4d69d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.072834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f553f48b-26ad-4cc3-a169-9f543c4d69d5 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:30.074208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f553f48b-26ad-4cc3-a169-9f543c4d69d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:30.080840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:30.122789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283d18-e723-4905-977a-c4db967c4019 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:30.193354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d085bc6-0a1a-45c3-a877-823351b852ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:30.195303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d085bc6-0a1a-45c3-a877-823351b852ac None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.195587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d085bc6-0a1a-45c3-a877-823351b852ac None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.195860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d085bc6-0a1a-45c3-a877-823351b852ac None admin] PATH_INFO: `/v3/users/61797b98529e41a1b0b656b115b3011e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.217350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d085bc6-0a1a-45c3-a877-823351b852ac None admin] RBAC: Authorizing `identity:get_user(user_id=61797b98529e41a1b0b656b115b3011e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:30.218498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 53/105] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:30.219758 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553f48b-26ad-4cc3-a169-9f543c4d69d5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:30.222511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d085bc6-0a1a-45c3-a877-823351b852ac None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:30.224420 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 53/106] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:29 2022] GET /identity/v3/users/61797b98529e41a1b0b656b115b3011e => generated 289 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:30.231115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d085bc6-0a1a-45c3-a877-823351b852ac None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:30.314283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:30.353707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d085bc6-0a1a-45c3-a877-823351b852ac None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:30.356986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553f48b-26ad-4cc3-a169-9f543c4d69d5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:30.388714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f852-663a-47c6-9f75-f37d4bedcf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:30.389253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f852-663a-47c6-9f75-f37d4bedcf6e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.389573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f852-663a-47c6-9f75-f37d4bedcf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.389845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f852-663a-47c6-9f75-f37d4bedcf6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.393282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a218-681c-4a50-a04f-84a0018e07f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:30.393947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a218-681c-4a50-a04f-84a0018e07f5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.394232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a218-681c-4a50-a04f-84a0018e07f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.394320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:30.394532 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a218-681c-4a50-a04f-84a0018e07f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.396000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7a218-681c-4a50-a04f-84a0018e07f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:30.397594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7a218-681c-4a50-a04f-84a0018e07f5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:30.399270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 54/107] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:30.399270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a218-681c-4a50-a04f-84a0018e07f5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:30.469732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09f852-663a-47c6-9f75-f37d4bedcf6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:30.471258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09f852-663a-47c6-9f75-f37d4bedcf6e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:30.505782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a218-681c-4a50-a04f-84a0018e07f5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:30.535206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:30.541307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023efd1-7988-4d40-a246-d5e5171b8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:30.541971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023efd1-7988-4d40-a246-d5e5171b8c3a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.542258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023efd1-7988-4d40-a246-d5e5171b8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.542534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023efd1-7988-4d40-a246-d5e5171b8c3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.553490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023efd1-7988-4d40-a246-d5e5171b8c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5023efd1-7988-4d40-a246-d5e5171b8c3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:30.558528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:30.559421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:30.560190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 55/108] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:13:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:30.561331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecf853-f4f7-4319-ba12-3cdba31b47d5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.561331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecf853-f4f7-4319-ba12-3cdba31b47d5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.561547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecf853-f4f7-4319-ba12-3cdba31b47d5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.562816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 56/109] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:30.563854 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c81997-8649-4214-8fda-a1cc2497cf8e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.564137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c81997-8649-4214-8fda-a1cc2497cf8e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.564576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c81997-8649-4214-8fda-a1cc2497cf8e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.569436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 57/110] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:30.570447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c81997-8649-4214-8fda-a1cc2497cf8e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:30.589123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 54/111] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:30.590108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f852-663a-47c6-9f75-f37d4bedcf6e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:30.633953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:30.699352 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c81997-8649-4214-8fda-a1cc2497cf8e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:30.709366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f852-663a-47c6-9f75-f37d4bedcf6e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:30.743837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334a53-293e-465b-825b-bf9aecac84cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:30.744114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f0341-1537-494b-94dd-7540611524b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:30.744489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334a53-293e-465b-825b-bf9aecac84cb None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.744579 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f0341-1537-494b-94dd-7540611524b8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.744771 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334a53-293e-465b-825b-bf9aecac84cb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.744865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f0341-1537-494b-94dd-7540611524b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.745048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334a53-293e-465b-825b-bf9aecac84cb None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.745131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f0341-1537-494b-94dd-7540611524b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.745788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334a53-293e-465b-825b-bf9aecac84cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:30.745885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f0341-1537-494b-94dd-7540611524b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:30.746189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f0341-1537-494b-94dd-7540611524b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:30.747292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334a53-293e-465b-825b-bf9aecac84cb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:30.747594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f0341-1537-494b-94dd-7540611524b8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:30.756327 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:30.757574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1011-d936-43e5-9f00-53abe08f1f8c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.757870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1011-d936-43e5-9f00-53abe08f1f8c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.758148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1011-d936-43e5-9f00-53abe08f1f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.775637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 58/113] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:13:30 2022] POST /identity/v3/projects => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:30.776977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56703d74-90c7-4e23-83f0-525f773d04c8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.777487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56703d74-90c7-4e23-83f0-525f773d04c8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.777651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56703d74-90c7-4e23-83f0-525f773d04c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.778705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-344f1011-d936-43e5-9f00-53abe08f1f8c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:30.779965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-344f1011-d936-43e5-9f00-53abe08f1f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:30.805805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-56703d74-90c7-4e23-83f0-525f773d04c8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:30.807038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-56703d74-90c7-4e23-83f0-525f773d04c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:30.860775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:30.862962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 56/114] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:30.863997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f1011-d936-43e5-9f00-53abe08f1f8c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:30.904699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 59/115] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:30.906105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d7dba-9628-4c7d-af3a-7ec71dbd6086 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:30.906389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d7dba-9628-4c7d-af3a-7ec71dbd6086 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:30.906664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d7dba-9628-4c7d-af3a-7ec71dbd6086 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:30.908262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 60/116] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:30.908863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d7dba-9628-4c7d-af3a-7ec71dbd6086 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:30.926121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:31.013294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f1011-d936-43e5-9f00-53abe08f1f8c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.034841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d7dba-9628-4c7d-af3a-7ec71dbd6086 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.049874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46716f9-63e3-4b0a-b4e5-67d78293e1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.050545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46716f9-63e3-4b0a-b4e5-67d78293e1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.050824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46716f9-63e3-4b0a-b4e5-67d78293e1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.051308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46716f9-63e3-4b0a-b4e5-67d78293e1f5 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.052516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46716f9-63e3-4b0a-b4e5-67d78293e1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:31.054070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46716f9-63e3-4b0a-b4e5-67d78293e1f5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:31.060552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 57/117] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:30 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:31.060552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46716f9-63e3-4b0a-b4e5-67d78293e1f5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:31.079150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8affcc-c175-4724-a86e-24a1caedc5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.079824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8affcc-c175-4724-a86e-24a1caedc5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.080110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8affcc-c175-4724-a86e-24a1caedc5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.080390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8affcc-c175-4724-a86e-24a1caedc5a0 None admin] PATH_INFO: `/v3/users/8e22a2638d8e425c934033b96ce6b062` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.081653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8affcc-c175-4724-a86e-24a1caedc5a0 None admin] RBAC: Authorizing `identity:get_user(user_id=8e22a2638d8e425c934033b96ce6b062)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:31.083197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8affcc-c175-4724-a86e-24a1caedc5a0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:31.089515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 61/118] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:30 2022] GET /identity/v3/users/8e22a2638d8e425c934033b96ce6b062 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:31.089515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f626bf-001e-49f0-a236-155302500d61 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.089515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f626bf-001e-49f0-a236-155302500d61 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.089515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f626bf-001e-49f0-a236-155302500d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.107100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-56f626bf-001e-49f0-a236-155302500d61 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:31.108312 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-56f626bf-001e-49f0-a236-155302500d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:31.149201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:31.188975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:31.194504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 62/119] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:31.195407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f626bf-001e-49f0-a236-155302500d61 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:31.200515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46716f9-63e3-4b0a-b4e5-67d78293e1f5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.249308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd91ab-f16f-44a1-a2f0-e94d254df920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.250316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd91ab-f16f-44a1-a2f0-e94d254df920 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.250792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd91ab-f16f-44a1-a2f0-e94d254df920 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.251244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd91ab-f16f-44a1-a2f0-e94d254df920 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.263704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd91ab-f16f-44a1-a2f0-e94d254df920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d8fd91ab-f16f-44a1-a2f0-e94d254df920 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:31.274573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:31.276285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:31.277989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:31.279151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 58/120] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:31.279672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd91ab-f16f-44a1-a2f0-e94d254df920 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:31.327318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f626bf-001e-49f0-a236-155302500d61 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.369048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bd92c-516c-45c1-9e07-ebda88ed5f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.370093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bd92c-516c-45c1-9e07-ebda88ed5f2a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.370204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bd92c-516c-45c1-9e07-ebda88ed5f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.370608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bd92c-516c-45c1-9e07-ebda88ed5f2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.382190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bd92c-516c-45c1-9e07-ebda88ed5f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-426bd92c-516c-45c1-9e07-ebda88ed5f2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:31.387326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:31.388204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:31.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 63/121] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:13:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:31.394451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bd92c-516c-45c1-9e07-ebda88ed5f2a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:31.396270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd91ab-f16f-44a1-a2f0-e94d254df920 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.432842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:31.436928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de15df-f88e-468f-a7cd-410d15d66a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.437660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de15df-f88e-468f-a7cd-410d15d66a60 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.437935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de15df-f88e-468f-a7cd-410d15d66a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.438230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de15df-f88e-468f-a7cd-410d15d66a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.439042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de15df-f88e-468f-a7cd-410d15d66a60 None admin] RBAC: Adding query filter params (role.id=d2c3206fe0a4419283e432c1f5e555e6, scope.project.id=8096b1508e644200a9a730939b83c252, user.id=61797b98529e41a1b0b656b115b3011e) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:31.439351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de15df-f88e-468f-a7cd-410d15d66a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:31.440821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de15df-f88e-468f-a7cd-410d15d66a60 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:31.449317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 59/122] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:31 2022] GET /identity/v3/role_assignments?user.id=61797b98529e41a1b0b656b115b3011e&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=d2c3206fe0a4419283e432c1f5e555e6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:31.449992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de15df-f88e-468f-a7cd-410d15d66a60 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:31.491716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:31.540424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bd92c-516c-45c1-9e07-ebda88ed5f2a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.594759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de15df-f88e-468f-a7cd-410d15d66a60 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.598936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717714f-5c09-416c-9790-0e6aa017dbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.599959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717714f-5c09-416c-9790-0e6aa017dbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.600421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717714f-5c09-416c-9790-0e6aa017dbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.600949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717714f-5c09-416c-9790-0e6aa017dbb1 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.602556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717714f-5c09-416c-9790-0e6aa017dbb1 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:31.604907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717714f-5c09-416c-9790-0e6aa017dbb1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:31.607936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 64/123] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:31 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:31.609025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717714f-5c09-416c-9790-0e6aa017dbb1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:31.658697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd2435-e434-4b65-9618-7d57da911adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.659477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd2435-e434-4b65-9618-7d57da911adb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.659824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd2435-e434-4b65-9618-7d57da911adb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.660167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd2435-e434-4b65-9618-7d57da911adb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.675926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd2435-e434-4b65-9618-7d57da911adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-57cd2435-e434-4b65-9618-7d57da911adb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:31.683164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:31.684083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:31.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 60/124] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:31.685591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd2435-e434-4b65-9618-7d57da911adb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:31.740980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:31.744906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717714f-5c09-416c-9790-0e6aa017dbb1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.783218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48155c7a-0273-49a6-854b-b66ba858d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.784139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48155c7a-0273-49a6-854b-b66ba858d097 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.784566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48155c7a-0273-49a6-854b-b66ba858d097 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.784985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48155c7a-0273-49a6-854b-b66ba858d097 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.785480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:31.786745 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48155c7a-0273-49a6-854b-b66ba858d097 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:31.787362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48155c7a-0273-49a6-854b-b66ba858d097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:31.788963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48155c7a-0273-49a6-854b-b66ba858d097 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:31.800666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 65/125] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:31.802083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48155c7a-0273-49a6-854b-b66ba858d097 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:31.810318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd2435-e434-4b65-9618-7d57da911adb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.851123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132869-921e-4b78-86fa-93714e44905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.852251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132869-921e-4b78-86fa-93714e44905a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.852251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132869-921e-4b78-86fa-93714e44905a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.852417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132869-921e-4b78-86fa-93714e44905a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.853165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01132869-921e-4b78-86fa-93714e44905a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:31.853525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01132869-921e-4b78-86fa-93714e44905a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:31.855376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01132869-921e-4b78-86fa-93714e44905a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:31.865998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 61/126] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:13:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:31.870554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132869-921e-4b78-86fa-93714e44905a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:31.926434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48155c7a-0273-49a6-854b-b66ba858d097 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.968074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d658b-fba7-4c02-b72e-787c2bb6cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:31.969556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d658b-fba7-4c02-b72e-787c2bb6cbd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:31.970026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d658b-fba7-4c02-b72e-787c2bb6cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:31.970592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d658b-fba7-4c02-b72e-787c2bb6cbd6 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252/users/8e22a2638d8e425c934033b96ce6b062/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:31.972967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d658b-fba7-4c02-b72e-787c2bb6cbd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8096b1508e644200a9a730939b83c252, user_id=8e22a2638d8e425c934033b96ce6b062, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:31.974749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d658b-fba7-4c02-b72e-787c2bb6cbd6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:31.989900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132869-921e-4b78-86fa-93714e44905a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:31.998262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 66/127] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:13:31 2022] PUT /identity/v3/projects/8096b1508e644200a9a730939b83c252/users/8e22a2638d8e425c934033b96ce6b062/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:13:31.998262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d658b-fba7-4c02-b72e-787c2bb6cbd6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:32.048268 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d0a57-777d-4a68-9ff9-fdb0a8a9ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:32.049020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d0a57-777d-4a68-9ff9-fdb0a8a9ffcc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.049333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d0a57-777d-4a68-9ff9-fdb0a8a9ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.049625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d0a57-777d-4a68-9ff9-fdb0a8a9ffcc None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.050354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d0a57-777d-4a68-9ff9-fdb0a8a9ffcc None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:32.050760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d0a57-777d-4a68-9ff9-fdb0a8a9ffcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:32.052466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d0a57-777d-4a68-9ff9-fdb0a8a9ffcc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:32.066120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 62/128] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:32.067137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d0a57-777d-4a68-9ff9-fdb0a8a9ffcc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:32.072415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:32.077585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:32.228397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d658b-fba7-4c02-b72e-787c2bb6cbd6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:32.250728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d0a57-777d-4a68-9ff9-fdb0a8a9ffcc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:32.267442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d8b16-fe02-46d7-973d-beb919fabeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:32.268547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d8b16-fe02-46d7-973d-beb919fabeac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.269121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d8b16-fe02-46d7-973d-beb919fabeac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.269647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d8b16-fe02-46d7-973d-beb919fabeac None admin] PATH_INFO: `/v3/users/66d89ddc6ddc4301a34002851e393306` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.271153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d8b16-fe02-46d7-973d-beb919fabeac None admin] RBAC: Authorizing `identity:get_user(user_id=66d89ddc6ddc4301a34002851e393306)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:32.273067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d8b16-fe02-46d7-973d-beb919fabeac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:32.275002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 67/129] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:31 2022] GET /identity/v3/users/66d89ddc6ddc4301a34002851e393306 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:32.276021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d8b16-fe02-46d7-973d-beb919fabeac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:32.289905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf521-55b4-4ed4-b04c-322ba4c931de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:32.290403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf521-55b4-4ed4-b04c-322ba4c931de None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.290688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf521-55b4-4ed4-b04c-322ba4c931de None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.290963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf521-55b4-4ed4-b04c-322ba4c931de None admin] PATH_INFO: `/v3/users/66d89ddc6ddc4301a34002851e393306` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.292212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf521-55b4-4ed4-b04c-322ba4c931de None admin] RBAC: Authorizing `identity:get_user(user_id=66d89ddc6ddc4301a34002851e393306)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:32.293754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf521-55b4-4ed4-b04c-322ba4c931de None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:32.295442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 63/130] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:32 2022] GET /identity/v3/users/66d89ddc6ddc4301a34002851e393306 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:32.296220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf521-55b4-4ed4-b04c-322ba4c931de None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:32.370989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:32.380569 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:32.393388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d8b16-fe02-46d7-973d-beb919fabeac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:32.410740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf521-55b4-4ed4-b04c-322ba4c931de None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:32.431695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d5f90-a2e0-4d11-befb-0703b457f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:32.432726 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d5f90-a2e0-4d11-befb-0703b457f06b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.433301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d5f90-a2e0-4d11-befb-0703b457f06b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.433796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d5f90-a2e0-4d11-befb-0703b457f06b None admin] PATH_INFO: `/v3/users/66d89ddc6ddc4301a34002851e393306` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.435263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d5f90-a2e0-4d11-befb-0703b457f06b None admin] RBAC: Authorizing `identity:get_user(user_id=66d89ddc6ddc4301a34002851e393306)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:32.437159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d5f90-a2e0-4d11-befb-0703b457f06b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:32.439588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 68/131] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:32 2022] GET /identity/v3/users/66d89ddc6ddc4301a34002851e393306 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:32.440589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d5f90-a2e0-4d11-befb-0703b457f06b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:32.483486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079e518-a7f3-41b4-9fa1-cf230824e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:32.483729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079e518-a7f3-41b4-9fa1-cf230824e2fa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.483942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079e518-a7f3-41b4-9fa1-cf230824e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.484205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079e518-a7f3-41b4-9fa1-cf230824e2fa None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.490039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079e518-a7f3-41b4-9fa1-cf230824e2fa None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:32.491528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079e518-a7f3-41b4-9fa1-cf230824e2fa None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:32.493287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 64/132] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:32 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:32.494153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079e518-a7f3-41b4-9fa1-cf230824e2fa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:32.553998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d5f90-a2e0-4d11-befb-0703b457f06b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:32.595022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c317-74e5-417d-90e2-58a7f5cd2d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:32.596658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c317-74e5-417d-90e2-58a7f5cd2d6a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.597418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c317-74e5-417d-90e2-58a7f5cd2d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.597972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c317-74e5-417d-90e2-58a7f5cd2d6a None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.599424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c317-74e5-417d-90e2-58a7f5cd2d6a None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:32.601087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c317-74e5-417d-90e2-58a7f5cd2d6a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:32.603244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 69/133] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:32 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:32.604335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c317-74e5-417d-90e2-58a7f5cd2d6a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:32.628565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079e518-a7f3-41b4-9fa1-cf230824e2fa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:32.653673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:32.665410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c05e2-d7cf-4b31-85a4-d4225cb06794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:32.666126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c05e2-d7cf-4b31-85a4-d4225cb06794 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.666414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c05e2-d7cf-4b31-85a4-d4225cb06794 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.666695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c05e2-d7cf-4b31-85a4-d4225cb06794 None admin] PATH_INFO: `/v3/projects/00484a9e74f749539691ebeec5f67597` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.668010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c05e2-d7cf-4b31-85a4-d4225cb06794 None admin] RBAC: Authorizing `identity:get_project(project_id=00484a9e74f749539691ebeec5f67597)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:32.670058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c05e2-d7cf-4b31-85a4-d4225cb06794 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:32.671515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 65/134] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:32 2022] GET /identity/v3/projects/00484a9e74f749539691ebeec5f67597 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:32.672261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c05e2-d7cf-4b31-85a4-d4225cb06794 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:32.684149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:32.736203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c317-74e5-417d-90e2-58a7f5cd2d6a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:32.773894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36401f-1fb7-436f-a177-9ffbf50cac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:32.775104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36401f-1fb7-436f-a177-9ffbf50cac00 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.775585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36401f-1fb7-436f-a177-9ffbf50cac00 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.775803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c05e2-d7cf-4b31-85a4-d4225cb06794 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:32.776255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36401f-1fb7-436f-a177-9ffbf50cac00 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252/users/66d89ddc6ddc4301a34002851e393306/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.778735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36401f-1fb7-436f-a177-9ffbf50cac00 None admin] RBAC: Authorizing `identity:create_grant(project_id=8096b1508e644200a9a730939b83c252, user_id=66d89ddc6ddc4301a34002851e393306, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:32.780488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36401f-1fb7-436f-a177-9ffbf50cac00 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:32.799528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 70/135] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:13:32 2022] PUT /identity/v3/projects/8096b1508e644200a9a730939b83c252/users/66d89ddc6ddc4301a34002851e393306/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:13:32.801120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36401f-1fb7-436f-a177-9ffbf50cac00 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:32.830980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6910147-fd62-478a-9ada-b2b40c6db9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:32.833339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6910147-fd62-478a-9ada-b2b40c6db9e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.835316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6910147-fd62-478a-9ada-b2b40c6db9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.836826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6910147-fd62-478a-9ada-b2b40c6db9e3 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252/users/66d89ddc6ddc4301a34002851e393306/roles/53cf1beeeaca4ae1b43e5399ce133329` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.845362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6910147-fd62-478a-9ada-b2b40c6db9e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8096b1508e644200a9a730939b83c252, user_id=66d89ddc6ddc4301a34002851e393306, role_id=53cf1beeeaca4ae1b43e5399ce133329)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:32.848063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6910147-fd62-478a-9ada-b2b40c6db9e3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:32.882449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 66/136] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:13:32 2022] PUT /identity/v3/projects/8096b1508e644200a9a730939b83c252/users/66d89ddc6ddc4301a34002851e393306/roles/53cf1beeeaca4ae1b43e5399ce133329 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:13:32.950110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48485-e8cc-43c5-820b-7b8edddbdb0a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.950774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48485-e8cc-43c5-820b-7b8edddbdb0a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.951249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48485-e8cc-43c5-820b-7b8edddbdb0a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.953103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 67/137] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:32.960383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37945cc3-2b42-4b07-b721-3520bcb37fbb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:32.961082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37945cc3-2b42-4b07-b721-3520bcb37fbb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:32.961700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37945cc3-2b42-4b07-b721-3520bcb37fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:32.980748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:32.994966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-37945cc3-2b42-4b07-b721-3520bcb37fbb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:32.997977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-37945cc3-2b42-4b07-b721-3520bcb37fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:33.007723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36401f-1fb7-436f-a177-9ffbf50cac00 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:33.071436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf945c1-5e25-4f1a-afe4-787adffdbb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:33.072403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf945c1-5e25-4f1a-afe4-787adffdbb78 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:33.073588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf945c1-5e25-4f1a-afe4-787adffdbb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:33.074020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf945c1-5e25-4f1a-afe4-787adffdbb78 None admin] PATH_INFO: `/v3/projects/00484a9e74f749539691ebeec5f67597/users/66d89ddc6ddc4301a34002851e393306/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:33.077236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf945c1-5e25-4f1a-afe4-787adffdbb78 None admin] RBAC: Authorizing `identity:create_grant(project_id=00484a9e74f749539691ebeec5f67597, user_id=66d89ddc6ddc4301a34002851e393306, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:33.078913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf945c1-5e25-4f1a-afe4-787adffdbb78 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:33.096496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 71/138] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:13:32 2022] PUT /identity/v3/projects/00484a9e74f749539691ebeec5f67597/users/66d89ddc6ddc4301a34002851e393306/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:13:33.097648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:33.103202 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 68/139] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:33.132282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf945c1-5e25-4f1a-afe4-787adffdbb78 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:33.244173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf945c1-5e25-4f1a-afe4-787adffdbb78 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:33.280967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d1ae8-e190-4c34-91df-fa814ae33ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:33.281714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1ae8-e190-4c34-91df-fa814ae33ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:33.282005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1ae8-e190-4c34-91df-fa814ae33ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:33.282281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1ae8-e190-4c34-91df-fa814ae33ea2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:33.283489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d1ae8-e190-4c34-91df-fa814ae33ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:33.284990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d1ae8-e190-4c34-91df-fa814ae33ea2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:33.286774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 72/140] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:33.292614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37945cc3-2b42-4b07-b721-3520bcb37fbb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:33.403310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37945cc3-2b42-4b07-b721-3520bcb37fbb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:33.441393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa3920-c3aa-4a69-acd2-348842409800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:33.442101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa3920-c3aa-4a69-acd2-348842409800 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:33.442389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa3920-c3aa-4a69-acd2-348842409800 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:33.442669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa3920-c3aa-4a69-acd2-348842409800 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:33.443385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa3920-c3aa-4a69-acd2-348842409800 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:33.444923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa3920-c3aa-4a69-acd2-348842409800 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:33.474837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 69/141] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:13:33 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:33.994512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5541df5-3d44-439b-ac14-7230b0c6f2a2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:33.995034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5541df5-3d44-439b-ac14-7230b0c6f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:33.995148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5541df5-3d44-439b-ac14-7230b0c6f2a2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:33.996600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 73/142] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:34.002396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caff1ad-0b52-4215-a887-d05d720f581b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:34.002674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caff1ad-0b52-4215-a887-d05d720f581b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:34.002958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caff1ad-0b52-4215-a887-d05d720f581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:34.026335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1caff1ad-0b52-4215-a887-d05d720f581b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:34.027575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1caff1ad-0b52-4215-a887-d05d720f581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:34.104120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:34.127947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 70/143] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:34.169596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5541df5-3d44-439b-ac14-7230b0c6f2a2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:34.198657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:34.311075 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5541df5-3d44-439b-ac14-7230b0c6f2a2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:34.356136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52767d1-8ff4-4499-ae66-fdba430354de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:34.356817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52767d1-8ff4-4499-ae66-fdba430354de None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:34.357089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52767d1-8ff4-4499-ae66-fdba430354de None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:34.357384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52767d1-8ff4-4499-ae66-fdba430354de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:34.372217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52767d1-8ff4-4499-ae66-fdba430354de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b52767d1-8ff4-4499-ae66-fdba430354de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:34.378660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:34.379665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:34.380447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 74/144] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:34.387883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caff1ad-0b52-4215-a887-d05d720f581b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:34.562467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caff1ad-0b52-4215-a887-d05d720f581b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:34.609024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05869902-3e9e-45a8-ac0b-d90f9d4750e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:34.609750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05869902-3e9e-45a8-ac0b-d90f9d4750e5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:34.610035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05869902-3e9e-45a8-ac0b-d90f9d4750e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:34.610309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05869902-3e9e-45a8-ac0b-d90f9d4750e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:34.611463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05869902-3e9e-45a8-ac0b-d90f9d4750e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:34.611720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05869902-3e9e-45a8-ac0b-d90f9d4750e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:34.613391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05869902-3e9e-45a8-ac0b-d90f9d4750e5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:34.624085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 71/145] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:34.632296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52767d1-8ff4-4499-ae66-fdba430354de None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:34.726386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:34.759178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52767d1-8ff4-4499-ae66-fdba430354de None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:34.801113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5232-cbae-421b-8e7a-58ef561aab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:34.801943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5232-cbae-421b-8e7a-58ef561aab72 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:34.802224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5232-cbae-421b-8e7a-58ef561aab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:34.802530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5232-cbae-421b-8e7a-58ef561aab72 None admin] PATH_INFO: `/v3/users/61797b98529e41a1b0b656b115b3011e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:34.803793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e5232-cbae-421b-8e7a-58ef561aab72 None admin] RBAC: Authorizing `identity:get_user(user_id=61797b98529e41a1b0b656b115b3011e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:34.805315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e5232-cbae-421b-8e7a-58ef561aab72 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:34.807029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 75/146] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:34 2022] GET /identity/v3/users/61797b98529e41a1b0b656b115b3011e => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:34.813119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05869902-3e9e-45a8-ac0b-d90f9d4750e5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:34.870420 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:34.931896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05869902-3e9e-45a8-ac0b-d90f9d4750e5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:34.973935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ed0e-686d-4384-b90c-58081c255bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:34.974602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ed0e-686d-4384-b90c-58081c255bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:34.974877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ed0e-686d-4384-b90c-58081c255bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:34.975144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ed0e-686d-4384-b90c-58081c255bd5 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:34.976342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ed0e-686d-4384-b90c-58081c255bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:34.977827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ed0e-686d-4384-b90c-58081c255bd5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:34.979543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 72/147] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:34 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:34.985766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5232-cbae-421b-8e7a-58ef561aab72 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:35.100973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5232-cbae-421b-8e7a-58ef561aab72 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:35.142108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae293a7-4e03-4479-9ecc-ca3cd21d681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:35.142846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae293a7-4e03-4479-9ecc-ca3cd21d681e None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:35.143133 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae293a7-4e03-4479-9ecc-ca3cd21d681e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:35.143412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae293a7-4e03-4479-9ecc-ca3cd21d681e None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252/users/61797b98529e41a1b0b656b115b3011e/roles/d2c3206fe0a4419283e432c1f5e555e6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:35.145837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae293a7-4e03-4479-9ecc-ca3cd21d681e None admin] RBAC: Authorizing `identity:create_grant(project_id=8096b1508e644200a9a730939b83c252, user_id=61797b98529e41a1b0b656b115b3011e, role_id=d2c3206fe0a4419283e432c1f5e555e6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:35.147336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae293a7-4e03-4479-9ecc-ca3cd21d681e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:35.174038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 76/148] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:13:34 2022] PUT /identity/v3/projects/8096b1508e644200a9a730939b83c252/users/61797b98529e41a1b0b656b115b3011e/roles/d2c3206fe0a4419283e432c1f5e555e6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:13:35.547044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e77f-2e9e-49b8-9d22-68c3bebe3b6f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:35.547437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e77f-2e9e-49b8-9d22-68c3bebe3b6f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:35.547627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e77f-2e9e-49b8-9d22-68c3bebe3b6f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:35.549169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 73/149] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:35.554939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b435-b411-4654-973e-7836052ecd30 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:35.555230 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b435-b411-4654-973e-7836052ecd30 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:35.555512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b435-b411-4654-973e-7836052ecd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:35.561955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:35.579128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-14d9b435-b411-4654-973e-7836052ecd30 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:35.580335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-14d9b435-b411-4654-973e-7836052ecd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:35.662373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 77/150] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:35.719981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33e77f-2e9e-49b8-9d22-68c3bebe3b6f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:35.869461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33e77f-2e9e-49b8-9d22-68c3bebe3b6f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:35.886327 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:35.912273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b064fb-a9a0-42f9-accf-d99939665c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:35.912939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b064fb-a9a0-42f9-accf-d99939665c54 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:35.913218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b064fb-a9a0-42f9-accf-d99939665c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:35.913557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b064fb-a9a0-42f9-accf-d99939665c54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:35.928148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b064fb-a9a0-42f9-accf-d99939665c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b2b064fb-a9a0-42f9-accf-d99939665c54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:35.933637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:35.934633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:35.935442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 74/151] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:35.942790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b435-b411-4654-973e-7836052ecd30 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:36.083790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b435-b411-4654-973e-7836052ecd30 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:36.116363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:36.125632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fc63b-c8aa-48f0-bbb2-6b67fd7589ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:36.126201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fc63b-c8aa-48f0-bbb2-6b67fd7589ea None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:36.126479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fc63b-c8aa-48f0-bbb2-6b67fd7589ea None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:36.126750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fc63b-c8aa-48f0-bbb2-6b67fd7589ea None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:36.127489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fc63b-c8aa-48f0-bbb2-6b67fd7589ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:36.127787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fc63b-c8aa-48f0-bbb2-6b67fd7589ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:36.129364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fc63b-c8aa-48f0-bbb2-6b67fd7589ea None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:36.138584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 78/152] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:36.144549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b064fb-a9a0-42f9-accf-d99939665c54 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:36.292238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b064fb-a9a0-42f9-accf-d99939665c54 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:36.339354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4456aee-05f6-4e25-86c0-8c4da8a5cdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:36.340023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456aee-05f6-4e25-86c0-8c4da8a5cdbf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:36.340305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456aee-05f6-4e25-86c0-8c4da8a5cdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:36.340582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456aee-05f6-4e25-86c0-8c4da8a5cdbf None admin] PATH_INFO: `/v3/users/8e22a2638d8e425c934033b96ce6b062` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:36.341884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4456aee-05f6-4e25-86c0-8c4da8a5cdbf None admin] RBAC: Authorizing `identity:get_user(user_id=8e22a2638d8e425c934033b96ce6b062)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:36.343361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4456aee-05f6-4e25-86c0-8c4da8a5cdbf None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:36.345576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 75/153] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:36 2022] GET /identity/v3/users/8e22a2638d8e425c934033b96ce6b062 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:36.351445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fc63b-c8aa-48f0-bbb2-6b67fd7589ea None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:36.397089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb7f5-159b-405a-a81c-f5014d7367d9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:36.397253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb7f5-159b-405a-a81c-f5014d7367d9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:36.397568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb7f5-159b-405a-a81c-f5014d7367d9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:36.399096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 76/154] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:36.405488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc350ba-f4ba-478c-91a3-b2b80eea32de None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:36.405778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc350ba-f4ba-478c-91a3-b2b80eea32de None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:36.406061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc350ba-f4ba-478c-91a3-b2b80eea32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:36.442493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2fc350ba-f4ba-478c-91a3-b2b80eea32de None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:36.443734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2fc350ba-f4ba-478c-91a3-b2b80eea32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:36.530473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:36.543614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fc63b-c8aa-48f0-bbb2-6b67fd7589ea None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:36.595222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:36.623330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849e566-31be-4551-90d1-43914df14aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:36.623976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e566-31be-4551-90d1-43914df14aad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:36.624256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e566-31be-4551-90d1-43914df14aad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:36.624526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e566-31be-4551-90d1-43914df14aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:36.670468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc350ba-f4ba-478c-91a3-b2b80eea32de None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:36.757776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:36.770851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849e566-31be-4551-90d1-43914df14aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:36.772562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849e566-31be-4551-90d1-43914df14aad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:36.929837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc350ba-f4ba-478c-91a3-b2b80eea32de None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:36.985725 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ec2fe-f665-44b6-8b3e-aada4548c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:36.986407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ec2fe-f665-44b6-8b3e-aada4548c1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:36.986684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ec2fe-f665-44b6-8b3e-aada4548c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:36.986954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ec2fe-f665-44b6-8b3e-aada4548c1c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:37.008048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ec2fe-f665-44b6-8b3e-aada4548c1c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1d2ec2fe-f665-44b6-8b3e-aada4548c1c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:37.013280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:37.014371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:37.015194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 78/156] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:13:37.029442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372d3f-1329-4e10-9dc6-0d443931d4bf None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:37.029856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372d3f-1329-4e10-9dc6-0d443931d4bf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:37.030132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372d3f-1329-4e10-9dc6-0d443931d4bf None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:37.031943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 79/157] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:37 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:37.032762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1372d3f-1329-4e10-9dc6-0d443931d4bf None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:37.056180 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 79/158] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:37.057804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdae1c5-cd87-44e0-9a04-140eee14e07c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:37.058261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdae1c5-cd87-44e0-9a04-140eee14e07c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:37.058709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdae1c5-cd87-44e0-9a04-140eee14e07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:37.093239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:37.110303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7cdae1c5-cd87-44e0-9a04-140eee14e07c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:37.111512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7cdae1c5-cd87-44e0-9a04-140eee14e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:37.257967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1372d3f-1329-4e10-9dc6-0d443931d4bf None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:37.303637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 80/159] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:37.304531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdae1c5-cd87-44e0-9a04-140eee14e07c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:37.339024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5666-bab9-4046-828a-9a1fffb4c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:37.339676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5666-bab9-4046-828a-9a1fffb4c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:37.339951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5666-bab9-4046-828a-9a1fffb4c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:37.340218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5666-bab9-4046-828a-9a1fffb4c4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:37.340957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5666-bab9-4046-828a-9a1fffb4c4a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:37.341271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5666-bab9-4046-828a-9a1fffb4c4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:37.342693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5666-bab9-4046-828a-9a1fffb4c4a4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:37.355554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:37.361039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 80/160] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:37.362363 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1f86-09ad-4865-b688-0387f359b224 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:37.362645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1f86-09ad-4865-b688-0387f359b224 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:37.362916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1f86-09ad-4865-b688-0387f359b224 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:37.364237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 81/161] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:37.364932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1f86-09ad-4865-b688-0387f359b224 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:37.533806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:37.543345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdae1c5-cd87-44e0-9a04-140eee14e07c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:37.549515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1f86-09ad-4865-b688-0387f359b224 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:37.615557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca11d1-8d8d-4807-ac20-5caf0c28dbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:37.616239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca11d1-8d8d-4807-ac20-5caf0c28dbad None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:37.616519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca11d1-8d8d-4807-ac20-5caf0c28dbad None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:37.616796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca11d1-8d8d-4807-ac20-5caf0c28dbad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:37.627485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ab68a-3f6c-47eb-b7d1-a9c067b59ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:37.628169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab68a-3f6c-47eb-b7d1-a9c067b59ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:37.628448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab68a-3f6c-47eb-b7d1-a9c067b59ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:37.628723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab68a-3f6c-47eb-b7d1-a9c067b59ed5 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:37.638209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ab68a-3f6c-47eb-b7d1-a9c067b59ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:37.639726 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ab68a-3f6c-47eb-b7d1-a9c067b59ed5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:37.645817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 81/162] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:37 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:37.646000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca11d1-8d8d-4807-ac20-5caf0c28dbad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:37.647159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566936ab-321f-42b6-951f-d3df571cbac3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:37.647453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566936ab-321f-42b6-951f-d3df571cbac3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:37.647770 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566936ab-321f-42b6-951f-d3df571cbac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8eca11d1-8d8d-4807-ac20-5caf0c28dbad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:37.651554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:37.652980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 82/163] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:37.654474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca11d1-8d8d-4807-ac20-5caf0c28dbad None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:37.682487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-566936ab-321f-42b6-951f-d3df571cbac3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:37.684100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-566936ab-321f-42b6-951f-d3df571cbac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:37.855884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca11d1-8d8d-4807-ac20-5caf0c28dbad None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:37.857869 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 82/164] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:37.859146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566936ab-321f-42b6-951f-d3df571cbac3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:37.912989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:37.938686 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0ba78-7a6c-4c9d-8124-55b9744f826b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:37.939400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0ba78-7a6c-4c9d-8124-55b9744f826b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:37.939751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0ba78-7a6c-4c9d-8124-55b9744f826b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:37.939910 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0ba78-7a6c-4c9d-8124-55b9744f826b None admin] PATH_INFO: `/v3/users/66d89ddc6ddc4301a34002851e393306` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:37.946221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0ba78-7a6c-4c9d-8124-55b9744f826b None admin] RBAC: Authorizing `identity:get_user(user_id=66d89ddc6ddc4301a34002851e393306)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:37.947927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0ba78-7a6c-4c9d-8124-55b9744f826b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:37.950093 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 83/165] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:37 2022] GET /identity/v3/users/66d89ddc6ddc4301a34002851e393306 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:37.950919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0ba78-7a6c-4c9d-8124-55b9744f826b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:38.025640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:38.090883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566936ab-321f-42b6-951f-d3df571cbac3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:38.148969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4ddf-ee2b-4925-8874-4200395babac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:38.149572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4ddf-ee2b-4925-8874-4200395babac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.149858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4ddf-ee2b-4925-8874-4200395babac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.150129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4ddf-ee2b-4925-8874-4200395babac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.150950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff4ddf-ee2b-4925-8874-4200395babac None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=8096b1508e644200a9a730939b83c252, user.id=8e22a2638d8e425c934033b96ce6b062) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:38.151252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff4ddf-ee2b-4925-8874-4200395babac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:38.152710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff4ddf-ee2b-4925-8874-4200395babac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:38.161612 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 83/166] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:37 2022] GET /identity/v3/role_assignments?user.id=8e22a2638d8e425c934033b96ce6b062&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:38.162463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4ddf-ee2b-4925-8874-4200395babac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:38.237050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0ba78-7a6c-4c9d-8124-55b9744f826b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:38.279433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f518564-a664-40f1-a538-e0c442f68f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:38.280441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f518564-a664-40f1-a538-e0c442f68f80 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.280938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f518564-a664-40f1-a538-e0c442f68f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.281435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f518564-a664-40f1-a538-e0c442f68f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.282476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f518564-a664-40f1-a538-e0c442f68f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:38.283021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f518564-a664-40f1-a538-e0c442f68f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:38.284609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f518564-a664-40f1-a538-e0c442f68f80 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:38.297254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 84/167] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:38.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f518564-a664-40f1-a538-e0c442f68f80 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:38.362513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:38.382286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4ddf-ee2b-4925-8874-4200395babac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:38.415493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:38.424908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a8584-2e6b-4d41-bfb3-1309677b88a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:38.424908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a8584-2e6b-4d41-bfb3-1309677b88a3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.424908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a8584-2e6b-4d41-bfb3-1309677b88a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.425465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a8584-2e6b-4d41-bfb3-1309677b88a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.435993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f518564-a664-40f1-a538-e0c442f68f80 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:38.442776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a8584-2e6b-4d41-bfb3-1309677b88a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-641a8584-2e6b-4d41-bfb3-1309677b88a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:38.447549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:38.450604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 84/168] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:13:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:38.451524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b2b5-8957-44de-a5f6-4f6b4cc05932 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.452241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b2b5-8957-44de-a5f6-4f6b4cc05932 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.452241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b2b5-8957-44de-a5f6-4f6b4cc05932 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.452241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 85/169] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:38.457483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d953a9-a2b1-45c3-be9f-8e0532f0e0f6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.457792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d953a9-a2b1-45c3-be9f-8e0532f0e0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.458028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d953a9-a2b1-45c3-be9f-8e0532f0e0f6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.460437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 86/170] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:38.462023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752c637-912c-474a-bbda-c58c828a2df9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.462413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752c637-912c-474a-bbda-c58c828a2df9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.462828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752c637-912c-474a-bbda-c58c828a2df9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.464184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 87/171] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:38.464934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752c637-912c-474a-bbda-c58c828a2df9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:38.485811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d94b9a-3f63-410f-a588-36b56e2844be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:38.486452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d94b9a-3f63-410f-a588-36b56e2844be None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.486843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d94b9a-3f63-410f-a588-36b56e2844be None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.487016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d94b9a-3f63-410f-a588-36b56e2844be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.568545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d94b9a-3f63-410f-a588-36b56e2844be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:38.570097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d94b9a-3f63-410f-a588-36b56e2844be None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:38.594620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752c637-912c-474a-bbda-c58c828a2df9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:38.634702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d7b42-e7eb-4d35-9341-b91e14943d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:38.634849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7b42-e7eb-4d35-9341-b91e14943d0e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.635041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7b42-e7eb-4d35-9341-b91e14943d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.635317 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7b42-e7eb-4d35-9341-b91e14943d0e None admin] PATH_INFO: `/v3/users/66d89ddc6ddc4301a34002851e393306` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.636839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d7b42-e7eb-4d35-9341-b91e14943d0e None admin] RBAC: Authorizing `identity:get_user(user_id=66d89ddc6ddc4301a34002851e393306)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:38.638347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d7b42-e7eb-4d35-9341-b91e14943d0e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:38.640159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 88/172] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:38 2022] GET /identity/v3/users/66d89ddc6ddc4301a34002851e393306 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:38.641157 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf34de-9871-4a61-8486-9950e54a3f23 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.641463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf34de-9871-4a61-8486-9950e54a3f23 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.641737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf34de-9871-4a61-8486-9950e54a3f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.660940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3baf34de-9871-4a61-8486-9950e54a3f23 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:38.662182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3baf34de-9871-4a61-8486-9950e54a3f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:38.666922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:38.672616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:38.686805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 85/173] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:38.687500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d94b9a-3f63-410f-a588-36b56e2844be None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:38.738926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:38.742737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f41c8-3fb3-44db-ad74-801b17f66b87 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.743022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f41c8-3fb3-44db-ad74-801b17f66b87 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.743291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f41c8-3fb3-44db-ad74-801b17f66b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.762303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-601f41c8-3fb3-44db-ad74-801b17f66b87 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:38.763558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-601f41c8-3fb3-44db-ad74-801b17f66b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:38.805313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d94b9a-3f63-410f-a588-36b56e2844be None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:38.830667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 90/175] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:38.834667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c6240-3304-4ced-a872-9bb64c4c6ba8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.834964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c6240-3304-4ced-a872-9bb64c4c6ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.835248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c6240-3304-4ced-a872-9bb64c4c6ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.839830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3370777-5cfb-4fa7-9844-07ebf64aa580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:38.840460 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3370777-5cfb-4fa7-9844-07ebf64aa580 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.840734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3370777-5cfb-4fa7-9844-07ebf64aa580 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.841001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3370777-5cfb-4fa7-9844-07ebf64aa580 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:38.841751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3370777-5cfb-4fa7-9844-07ebf64aa580 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:38.842053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3370777-5cfb-4fa7-9844-07ebf64aa580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:38.843431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3370777-5cfb-4fa7-9844-07ebf64aa580 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:38.853370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 86/176] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:13:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:38.853370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3370777-5cfb-4fa7-9844-07ebf64aa580 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:38.853947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-df0c6240-3304-4ced-a872-9bb64c4c6ba8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:38.855072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df0c6240-3304-4ced-a872-9bb64c4c6ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:38.899745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:38.923669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 91/177] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:38.924440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c6240-3304-4ced-a872-9bb64c4c6ba8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:38.928397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:38.961247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3370777-5cfb-4fa7-9844-07ebf64aa580 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:38.996528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205eb0f5-334c-47ed-9a90-25ab374430e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:38.997182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eb0f5-334c-47ed-9a90-25ab374430e4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:38.997497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eb0f5-334c-47ed-9a90-25ab374430e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:38.998554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eb0f5-334c-47ed-9a90-25ab374430e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.028084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c6240-3304-4ced-a872-9bb64c4c6ba8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.062252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27631b2e-1135-4268-8b57-05d46261bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.062910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631b2e-1135-4268-8b57-05d46261bde2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.063183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631b2e-1135-4268-8b57-05d46261bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.063458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631b2e-1135-4268-8b57-05d46261bde2 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.064615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27631b2e-1135-4268-8b57-05d46261bde2 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:39.065958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eb0f5-334c-47ed-9a90-25ab374430e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:39.066073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27631b2e-1135-4268-8b57-05d46261bde2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:39.067532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eb0f5-334c-47ed-9a90-25ab374430e4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:39.067903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 92/178] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:38 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:39.068674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27631b2e-1135-4268-8b57-05d46261bde2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.112986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:39.139804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:39.169790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27631b2e-1135-4268-8b57-05d46261bde2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.178001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 87/179] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:39.178001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e02d5-c538-4d66-9ed3-69b3aa6fb66e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.178001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e02d5-c538-4d66-9ed3-69b3aa6fb66e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.178001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e02d5-c538-4d66-9ed3-69b3aa6fb66e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.178001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 88/180] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:39.178001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e02d5-c538-4d66-9ed3-69b3aa6fb66e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.204299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8108d-1cf5-401a-87de-d30140b330fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.204966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8108d-1cf5-401a-87de-d30140b330fb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.205229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8108d-1cf5-401a-87de-d30140b330fb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.205527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8108d-1cf5-401a-87de-d30140b330fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.215975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8108d-1cf5-401a-87de-d30140b330fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-57c8108d-1cf5-401a-87de-d30140b330fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:39.221348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:39.222274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:39.223196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 93/181] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:39.223884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8108d-1cf5-401a-87de-d30140b330fb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.277223 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e02d5-c538-4d66-9ed3-69b3aa6fb66e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.310593 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31506618-ed5c-4b98-a97d-6345ffb40f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.311249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31506618-ed5c-4b98-a97d-6345ffb40f33 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.311532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31506618-ed5c-4b98-a97d-6345ffb40f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.311806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31506618-ed5c-4b98-a97d-6345ffb40f33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.319950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8108d-1cf5-401a-87de-d30140b330fb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.322091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31506618-ed5c-4b98-a97d-6345ffb40f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-31506618-ed5c-4b98-a97d-6345ffb40f33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:39.327097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:39.328003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:39.328792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 89/182] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:13:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:39.329487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31506618-ed5c-4b98-a97d-6345ffb40f33 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.339568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:39.352519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:39.358260 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21b18c-a32e-444d-a607-945dc04eeaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.358915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21b18c-a32e-444d-a607-945dc04eeaea None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.359186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21b18c-a32e-444d-a607-945dc04eeaea None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.359452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21b18c-a32e-444d-a607-945dc04eeaea None admin] PATH_INFO: `/v3/users/66d89ddc6ddc4301a34002851e393306` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.360619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21b18c-a32e-444d-a607-945dc04eeaea None admin] RBAC: Authorizing `identity:get_user(user_id=66d89ddc6ddc4301a34002851e393306)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:39.362106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21b18c-a32e-444d-a607-945dc04eeaea None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:39.363748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 94/183] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:39 2022] GET /identity/v3/users/66d89ddc6ddc4301a34002851e393306 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:39.364505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21b18c-a32e-444d-a607-945dc04eeaea None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.437505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31506618-ed5c-4b98-a97d-6345ffb40f33 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.467205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21b18c-a32e-444d-a607-945dc04eeaea None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.472551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808297a0-7e28-4944-88a8-9abc4cf5b017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.473201 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808297a0-7e28-4944-88a8-9abc4cf5b017 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.473505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808297a0-7e28-4944-88a8-9abc4cf5b017 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.473775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808297a0-7e28-4944-88a8-9abc4cf5b017 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.474958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808297a0-7e28-4944-88a8-9abc4cf5b017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:39.476436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808297a0-7e28-4944-88a8-9abc4cf5b017 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:39.478081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 90/184] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:39.479227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125fc5-3d2b-4aa0-90dd-c343ad4899df None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.479470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125fc5-3d2b-4aa0-90dd-c343ad4899df None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.479741 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125fc5-3d2b-4aa0-90dd-c343ad4899df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.497533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-77125fc5-3d2b-4aa0-90dd-c343ad4899df None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:39.498749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-77125fc5-3d2b-4aa0-90dd-c343ad4899df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:39.502958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38afc7-7a0e-4d3f-8c46-be0c8ba718ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.503592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38afc7-7a0e-4d3f-8c46-be0c8ba718ec None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.503872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38afc7-7a0e-4d3f-8c46-be0c8ba718ec None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.504182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38afc7-7a0e-4d3f-8c46-be0c8ba718ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.504985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38afc7-7a0e-4d3f-8c46-be0c8ba718ec None admin] RBAC: Adding query filter params (role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=8096b1508e644200a9a730939b83c252, user.id=66d89ddc6ddc4301a34002851e393306) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:39.505315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38afc7-7a0e-4d3f-8c46-be0c8ba718ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:39.506767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38afc7-7a0e-4d3f-8c46-be0c8ba718ec None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:39.512815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 95/185] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:39 2022] GET /identity/v3/role_assignments?user.id=66d89ddc6ddc4301a34002851e393306&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:39.513640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38afc7-7a0e-4d3f-8c46-be0c8ba718ec None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.576684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 91/186] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:39.577709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125fc5-3d2b-4aa0-90dd-c343ad4899df None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.592352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:39.601090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:39.645972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38afc7-7a0e-4d3f-8c46-be0c8ba718ec None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.691919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9613e3-e4f3-4591-897a-e75ab39d3abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.692958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9613e3-e4f3-4591-897a-e75ab39d3abb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.693335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9613e3-e4f3-4591-897a-e75ab39d3abb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.693601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9613e3-e4f3-4591-897a-e75ab39d3abb None admin] PATH_INFO: `/v3/projects/00484a9e74f749539691ebeec5f67597` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.694827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9613e3-e4f3-4591-897a-e75ab39d3abb None admin] RBAC: Authorizing `identity:get_project(project_id=00484a9e74f749539691ebeec5f67597)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:39.698518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9613e3-e4f3-4591-897a-e75ab39d3abb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:39.700313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 96/187] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:39 2022] GET /identity/v3/projects/00484a9e74f749539691ebeec5f67597 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:39.701115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9613e3-e4f3-4591-897a-e75ab39d3abb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.716479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125fc5-3d2b-4aa0-90dd-c343ad4899df None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.760472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb8fa-ac7e-43b2-ae0d-b9aee210b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.761114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb8fa-ac7e-43b2-ae0d-b9aee210b821 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.761446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb8fa-ac7e-43b2-ae0d-b9aee210b821 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.761719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb8fa-ac7e-43b2-ae0d-b9aee210b821 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.762458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb8fa-ac7e-43b2-ae0d-b9aee210b821 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:39.762763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb8fa-ac7e-43b2-ae0d-b9aee210b821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:39.764181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb8fa-ac7e-43b2-ae0d-b9aee210b821 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:39.772943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 92/188] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:39.772943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb8fa-ac7e-43b2-ae0d-b9aee210b821 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.812000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9613e3-e4f3-4591-897a-e75ab39d3abb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.840626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:39.841705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:39.846692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7a5b9-5cd7-408c-905f-da519b8cac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.847341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7a5b9-5cd7-408c-905f-da519b8cac14 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.847758 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7a5b9-5cd7-408c-905f-da519b8cac14 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.848105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7a5b9-5cd7-408c-905f-da519b8cac14 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.848834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7a5b9-5cd7-408c-905f-da519b8cac14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:39.849147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7a5b9-5cd7-408c-905f-da519b8cac14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:39.850574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7a5b9-5cd7-408c-905f-da519b8cac14 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:39.863561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 97/189] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:13:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:39.863561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7a5b9-5cd7-408c-905f-da519b8cac14 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:39.878989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb8fa-ac7e-43b2-ae0d-b9aee210b821 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.919100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225edfc-dee5-4cdb-afc0-323024175509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:39.919734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225edfc-dee5-4cdb-afc0-323024175509 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:39.920011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225edfc-dee5-4cdb-afc0-323024175509 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:39.920281 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225edfc-dee5-4cdb-afc0-323024175509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:39.962915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7a5b9-5cd7-408c-905f-da519b8cac14 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:39.993123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225edfc-dee5-4cdb-afc0-323024175509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:39.994620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225edfc-dee5-4cdb-afc0-323024175509 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:39.999592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330461-f07a-4ee6-9c60-4d443f0ba1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:40.000234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330461-f07a-4ee6-9c60-4d443f0ba1b6 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:40.000510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330461-f07a-4ee6-9c60-4d443f0ba1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:40.000782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330461-f07a-4ee6-9c60-4d443f0ba1b6 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:40.001531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330461-f07a-4ee6-9c60-4d443f0ba1b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:40.003008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330461-f07a-4ee6-9c60-4d443f0ba1b6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:40.030357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 98/190] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:13:39 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:40.031926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330461-f07a-4ee6-9c60-4d443f0ba1b6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:40.084932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:40.132846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 93/191] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:40.132846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225edfc-dee5-4cdb-afc0-323024175509 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:40.135311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:40.198918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330461-f07a-4ee6-9c60-4d443f0ba1b6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:40.242673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1d42c-79cb-4fa6-a785-e4b5fa697765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:40.243279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1d42c-79cb-4fa6-a785-e4b5fa697765 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:40.243564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1d42c-79cb-4fa6-a785-e4b5fa697765 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:40.243841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1d42c-79cb-4fa6-a785-e4b5fa697765 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:40.256142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1d42c-79cb-4fa6-a785-e4b5fa697765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:40.261413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225edfc-dee5-4cdb-afc0-323024175509 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4cc1d42c-79cb-4fa6-a785-e4b5fa697765 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:40.261901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:40.273342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 99/192] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:40.274169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1d42c-79cb-4fa6-a785-e4b5fa697765 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:40.317953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47d2e9-716f-41f1-bcd6-e4568a9c5ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:40.318795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d2e9-716f-41f1-bcd6-e4568a9c5ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:40.319082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d2e9-716f-41f1-bcd6-e4568a9c5ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:40.320049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d2e9-716f-41f1-bcd6-e4568a9c5ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:40.320152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47d2e9-716f-41f1-bcd6-e4568a9c5ca5 None admin] RBAC: Adding query filter params (role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=00484a9e74f749539691ebeec5f67597, user.id=66d89ddc6ddc4301a34002851e393306) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:40.320468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47d2e9-716f-41f1-bcd6-e4568a9c5ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:40.322100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47d2e9-716f-41f1-bcd6-e4568a9c5ca5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:40.330658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 94/193] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:40 2022] GET /identity/v3/role_assignments?user.id=66d89ddc6ddc4301a34002851e393306&scope.project.id=00484a9e74f749539691ebeec5f67597&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:40.331529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47d2e9-716f-41f1-bcd6-e4568a9c5ca5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:40.382256 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:40.429840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1d42c-79cb-4fa6-a785-e4b5fa697765 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:40.465527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:40.494497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47d2e9-716f-41f1-bcd6-e4568a9c5ca5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:40.507158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402ff2a-3696-4509-b0e4-fb4f92dbb0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:40.508630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402ff2a-3696-4509-b0e4-fb4f92dbb0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:40.508909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402ff2a-3696-4509-b0e4-fb4f92dbb0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:40.509184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402ff2a-3696-4509-b0e4-fb4f92dbb0e9 None admin] PATH_INFO: `/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:40.533631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402ff2a-3696-4509-b0e4-fb4f92dbb0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=00a0c18a1f1d4b4d8ebb467d29e074df)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:40.536703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402ff2a-3696-4509-b0e4-fb4f92dbb0e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:40.540331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 100/194] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:40 2022] GET /identity/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:40.541226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402ff2a-3696-4509-b0e4-fb4f92dbb0e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:40.543679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559aa63-f91f-4eed-8638-b38c0cb43bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:40.544377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559aa63-f91f-4eed-8638-b38c0cb43bfd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:40.544658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559aa63-f91f-4eed-8638-b38c0cb43bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:40.544938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559aa63-f91f-4eed-8638-b38c0cb43bfd None admin] PATH_INFO: `/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:40.546478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559aa63-f91f-4eed-8638-b38c0cb43bfd None admin] RBAC: Authorizing `identity:get_user(user_id=00a0c18a1f1d4b4d8ebb467d29e074df)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:40.548026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559aa63-f91f-4eed-8638-b38c0cb43bfd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:40.551633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 95/195] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:40 2022] GET /identity/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:40.557299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559aa63-f91f-4eed-8638-b38c0cb43bfd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:40.676681 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402ff2a-3696-4509-b0e4-fb4f92dbb0e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:40.714904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:40.719681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559aa63-f91f-4eed-8638-b38c0cb43bfd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:40.736950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fea2f8-c7af-45e6-acd8-b9efa9328126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:40.737689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fea2f8-c7af-45e6-acd8-b9efa9328126 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:40.738057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fea2f8-c7af-45e6-acd8-b9efa9328126 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:40.738362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fea2f8-c7af-45e6-acd8-b9efa9328126 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:40.739587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fea2f8-c7af-45e6-acd8-b9efa9328126 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:40.741152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fea2f8-c7af-45e6-acd8-b9efa9328126 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:40.743474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 101/196] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:40 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:40.744363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fea2f8-c7af-45e6-acd8-b9efa9328126 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:40.759262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e56e4b-7728-41c3-bfa0-5df44f6eea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:40.759838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e56e4b-7728-41c3-bfa0-5df44f6eea25 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:40.760224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e56e4b-7728-41c3-bfa0-5df44f6eea25 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:40.760499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e56e4b-7728-41c3-bfa0-5df44f6eea25 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:40.761227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e56e4b-7728-41c3-bfa0-5df44f6eea25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:40.761713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e56e4b-7728-41c3-bfa0-5df44f6eea25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:40.763114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e56e4b-7728-41c3-bfa0-5df44f6eea25 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:40.783571 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 96/197] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:40.785449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e56e4b-7728-41c3-bfa0-5df44f6eea25 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:40.789064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:40.879618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fea2f8-c7af-45e6-acd8-b9efa9328126 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:40.904830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e56e4b-7728-41c3-bfa0-5df44f6eea25 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:40.924864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894b65-23d1-4e10-86e8-29c7ebef561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:40.925693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894b65-23d1-4e10-86e8-29c7ebef561d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:40.926132 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894b65-23d1-4e10-86e8-29c7ebef561d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:40.926503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894b65-23d1-4e10-86e8-29c7ebef561d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:40.943896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106544dd-6ea8-4d1b-9304-0761e290db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:40.944798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106544dd-6ea8-4d1b-9304-0761e290db22 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:40.945049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106544dd-6ea8-4d1b-9304-0761e290db22 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:40.945385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106544dd-6ea8-4d1b-9304-0761e290db22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:40.978111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:41.010453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c894b65-23d1-4e10-86e8-29c7ebef561d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:41.012247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c894b65-23d1-4e10-86e8-29c7ebef561d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:41.023117 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106544dd-6ea8-4d1b-9304-0761e290db22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:41.025168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106544dd-6ea8-4d1b-9304-0761e290db22 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:41.062397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:41.131494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 102/198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:41.132464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894b65-23d1-4e10-86e8-29c7ebef561d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:41.162579 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 97/199] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:41.164132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106544dd-6ea8-4d1b-9304-0761e290db22 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:41.229532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:41.259913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894b65-23d1-4e10-86e8-29c7ebef561d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:41.277992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106544dd-6ea8-4d1b-9304-0761e290db22 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:41.303951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432219c-47b9-4d2a-94a1-ca013f2ff086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:41.304746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432219c-47b9-4d2a-94a1-ca013f2ff086 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:41.305507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432219c-47b9-4d2a-94a1-ca013f2ff086 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:41.305507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432219c-47b9-4d2a-94a1-ca013f2ff086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:41.306477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432219c-47b9-4d2a-94a1-ca013f2ff086 None admin] RBAC: Adding query filter params (role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=8096b1508e644200a9a730939b83c252, user.id=66d89ddc6ddc4301a34002851e393306) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:41.306928 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432219c-47b9-4d2a-94a1-ca013f2ff086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:41.308632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432219c-47b9-4d2a-94a1-ca013f2ff086 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:41.312555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:41.316227 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 103/200] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:41 2022] GET /identity/v3/role_assignments?user.id=66d89ddc6ddc4301a34002851e393306&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:41.317408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432219c-47b9-4d2a-94a1-ca013f2ff086 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:41.329529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cd7da-9faf-4b22-aa58-3a906ae75884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:41.329529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cd7da-9faf-4b22-aa58-3a906ae75884 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:41.329529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cd7da-9faf-4b22-aa58-3a906ae75884 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:41.329529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cd7da-9faf-4b22-aa58-3a906ae75884 None admin] PATH_INFO: `/v3/users/61797b98529e41a1b0b656b115b3011e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:41.330045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cd7da-9faf-4b22-aa58-3a906ae75884 None admin] RBAC: Authorizing `identity:get_user(user_id=61797b98529e41a1b0b656b115b3011e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:41.330045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cd7da-9faf-4b22-aa58-3a906ae75884 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:41.337716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 98/201] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:41 2022] GET /identity/v3/users/61797b98529e41a1b0b656b115b3011e => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:41.341219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cd7da-9faf-4b22-aa58-3a906ae75884 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:41.481896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cd7da-9faf-4b22-aa58-3a906ae75884 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:41.511614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:41.521510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e271-3820-4d12-949d-c144cca4a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:41.522168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e271-3820-4d12-949d-c144cca4a39c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:41.522445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e271-3820-4d12-949d-c144cca4a39c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:41.522713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e271-3820-4d12-949d-c144cca4a39c None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:41.524102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339e271-3820-4d12-949d-c144cca4a39c None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:41.525611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339e271-3820-4d12-949d-c144cca4a39c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:41.527592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 99/202] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:41 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:41.528429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e271-3820-4d12-949d-c144cca4a39c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:41.532232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432219c-47b9-4d2a-94a1-ca013f2ff086 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:41.575229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3f2b1-2d0b-4c03-85ba-f2c336432f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:41.576653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3f2b1-2d0b-4c03-85ba-f2c336432f78 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:41.577412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3f2b1-2d0b-4c03-85ba-f2c336432f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:41.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3f2b1-2d0b-4c03-85ba-f2c336432f78 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:41.579582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3f2b1-2d0b-4c03-85ba-f2c336432f78 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:41.582122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3f2b1-2d0b-4c03-85ba-f2c336432f78 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:41.585496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 104/203] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:41 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:41.586507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3f2b1-2d0b-4c03-85ba-f2c336432f78 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:41.646435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e271-3820-4d12-949d-c144cca4a39c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:41.682246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:41.693302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885720f-d702-4bcf-aee1-2aff77fb3589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:41.694320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885720f-d702-4bcf-aee1-2aff77fb3589 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:41.694796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885720f-d702-4bcf-aee1-2aff77fb3589 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:41.695259 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885720f-d702-4bcf-aee1-2aff77fb3589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:41.726182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3f2b1-2d0b-4c03-85ba-f2c336432f78 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:41.762806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:41.769299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a7038-6d79-4ce4-ad3f-323183fb5fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:41.769299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a7038-6d79-4ce4-ad3f-323183fb5fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:41.769523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a7038-6d79-4ce4-ad3f-323183fb5fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:41.769862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a7038-6d79-4ce4-ad3f-323183fb5fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:41.771331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a7038-6d79-4ce4-ad3f-323183fb5fa0 None admin] RBAC: Adding query filter params (role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=6fe9341b7bf94c7bb282049899463dec, user.id=00a0c18a1f1d4b4d8ebb467d29e074df) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:41.771331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a7038-6d79-4ce4-ad3f-323183fb5fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:41.772297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a7038-6d79-4ce4-ad3f-323183fb5fa0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:41.778640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 105/204] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:41 2022] GET /identity/v3/role_assignments?user.id=00a0c18a1f1d4b4d8ebb467d29e074df&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:41.778975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885720f-d702-4bcf-aee1-2aff77fb3589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:41.779461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a7038-6d79-4ce4-ad3f-323183fb5fa0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:41.781029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885720f-d702-4bcf-aee1-2aff77fb3589 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:41.889883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 100/205] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:41.890647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a7038-6d79-4ce4-ad3f-323183fb5fa0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:41.895650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885720f-d702-4bcf-aee1-2aff77fb3589 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:41.921221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:41.926910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a90993-0a3a-4a87-a4ca-5ae46bed46f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:41.927548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a90993-0a3a-4a87-a4ca-5ae46bed46f7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:41.927825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a90993-0a3a-4a87-a4ca-5ae46bed46f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:41.928094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a90993-0a3a-4a87-a4ca-5ae46bed46f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:41.928904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a90993-0a3a-4a87-a4ca-5ae46bed46f7 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=6fe9341b7bf94c7bb282049899463dec, user.id=00a0c18a1f1d4b4d8ebb467d29e074df) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:41.929216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a90993-0a3a-4a87-a4ca-5ae46bed46f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:41.930839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a90993-0a3a-4a87-a4ca-5ae46bed46f7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:41.937537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 106/206] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:41 2022] GET /identity/v3/role_assignments?user.id=00a0c18a1f1d4b4d8ebb467d29e074df&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:42.032967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:42.041067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885720f-d702-4bcf-aee1-2aff77fb3589 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:42.093132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d0e41-69a8-46f5-9f8a-c26d3f27440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:42.094187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d0e41-69a8-46f5-9f8a-c26d3f27440c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:42.094462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d0e41-69a8-46f5-9f8a-c26d3f27440c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:42.094729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d0e41-69a8-46f5-9f8a-c26d3f27440c None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:42.095948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d0e41-69a8-46f5-9f8a-c26d3f27440c None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:42.097437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d0e41-69a8-46f5-9f8a-c26d3f27440c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:42.099452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 101/207] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:41 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:42.105381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a90993-0a3a-4a87-a4ca-5ae46bed46f7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:42.213690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a90993-0a3a-4a87-a4ca-5ae46bed46f7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:42.250193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b584a-e657-4319-b85b-a47cf050dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:42.250830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b584a-e657-4319-b85b-a47cf050dc99 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:42.251106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b584a-e657-4319-b85b-a47cf050dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:42.251376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b584a-e657-4319-b85b-a47cf050dc99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:42.252175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b584a-e657-4319-b85b-a47cf050dc99 None admin] RBAC: Adding query filter params (role.id=d2c3206fe0a4419283e432c1f5e555e6, scope.project.id=8096b1508e644200a9a730939b83c252, user.id=61797b98529e41a1b0b656b115b3011e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:42.252486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b584a-e657-4319-b85b-a47cf050dc99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:42.254088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b584a-e657-4319-b85b-a47cf050dc99 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:42.260591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 107/208] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:42 2022] GET /identity/v3/role_assignments?user.id=61797b98529e41a1b0b656b115b3011e&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=d2c3206fe0a4419283e432c1f5e555e6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:42.706912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc671b63-0ae2-4e88-a59b-db08937da554 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:42.707399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc671b63-0ae2-4e88-a59b-db08937da554 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:42.707534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc671b63-0ae2-4e88-a59b-db08937da554 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:42.709184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 102/209] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:42.714674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5f971-d7c3-4641-8594-231ed0ad5d12 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:42.715244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5f971-d7c3-4641-8594-231ed0ad5d12 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:42.715496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5f971-d7c3-4641-8594-231ed0ad5d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:42.738924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-76f5f971-d7c3-4641-8594-231ed0ad5d12 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:42.740901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76f5f971-d7c3-4641-8594-231ed0ad5d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:42.797946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:42.809327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 108/210] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:42.832863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc671b63-0ae2-4e88-a59b-db08937da554 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:42.936977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc671b63-0ae2-4e88-a59b-db08937da554 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:42.993515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9628a01-08b9-4660-996a-9ba5be14329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:42.994632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9628a01-08b9-4660-996a-9ba5be14329e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:42.995140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9628a01-08b9-4660-996a-9ba5be14329e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:42.995622 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9628a01-08b9-4660-996a-9ba5be14329e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:42.997677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9628a01-08b9-4660-996a-9ba5be14329e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:43.000408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9628a01-08b9-4660-996a-9ba5be14329e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:43.003349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 103/211] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:43.010242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5f971-d7c3-4641-8594-231ed0ad5d12 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:43.035683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13faafe-554d-48b3-a0ec-be7c5f32c49b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:43.036334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13faafe-554d-48b3-a0ec-be7c5f32c49b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:43.036334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13faafe-554d-48b3-a0ec-be7c5f32c49b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:43.038134 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 104/212] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:43.043439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98841005-7b53-44ab-848c-e365ad24533e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:43.043716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98841005-7b53-44ab-848c-e365ad24533e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:43.043991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98841005-7b53-44ab-848c-e365ad24533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:43.062956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-98841005-7b53-44ab-848c-e365ad24533e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:43.064187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-98841005-7b53-44ab-848c-e365ad24533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:43.093016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:43.118052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5f971-d7c3-4641-8594-231ed0ad5d12 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:43.143026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 105/213] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:43.154634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737619c-4bbc-45ef-bcf8-df23d7c07f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:43.155279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737619c-4bbc-45ef-bcf8-df23d7c07f95 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:43.155557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737619c-4bbc-45ef-bcf8-df23d7c07f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:43.155823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737619c-4bbc-45ef-bcf8-df23d7c07f95 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:43.156539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737619c-4bbc-45ef-bcf8-df23d7c07f95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:43.165346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737619c-4bbc-45ef-bcf8-df23d7c07f95 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:43.170807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98841005-7b53-44ab-848c-e365ad24533e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:43.197612 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 109/214] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:13:43 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:43.286374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98841005-7b53-44ab-848c-e365ad24533e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:43.324085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7749c-2413-4086-8dff-873b976a20f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:43.324768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7749c-2413-4086-8dff-873b976a20f0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:43.325048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7749c-2413-4086-8dff-873b976a20f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:43.325349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7749c-2413-4086-8dff-873b976a20f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:43.338673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7749c-2413-4086-8dff-873b976a20f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d1e7749c-2413-4086-8dff-873b976a20f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:43.344405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:43.345442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:43.346488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 106/215] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:43.354720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737619c-4bbc-45ef-bcf8-df23d7c07f95 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:43.405409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:43.464559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737619c-4bbc-45ef-bcf8-df23d7c07f95 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:43.500760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e21a0-0b02-4bd3-be06-8590cc1a68dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:43.501670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e21a0-0b02-4bd3-be06-8590cc1a68dd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:43.502089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e21a0-0b02-4bd3-be06-8590cc1a68dd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:43.502498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e21a0-0b02-4bd3-be06-8590cc1a68dd None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:43.503402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e21a0-0b02-4bd3-be06-8590cc1a68dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:43.503862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e21a0-0b02-4bd3-be06-8590cc1a68dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:43.505470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e21a0-0b02-4bd3-be06-8590cc1a68dd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:43.515726 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 110/216] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:43.521548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7749c-2413-4086-8dff-873b976a20f0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:43.561659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:43.663313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7749c-2413-4086-8dff-873b976a20f0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:43.710777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50447e07-ce95-4378-90d6-29ecaa02d655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:43.711634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50447e07-ce95-4378-90d6-29ecaa02d655 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:43.711920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50447e07-ce95-4378-90d6-29ecaa02d655 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:43.712266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50447e07-ce95-4378-90d6-29ecaa02d655 None admin] PATH_INFO: `/v3/users/00607e49167d4a6d889e3541d43e3e42` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:43.739403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50447e07-ce95-4378-90d6-29ecaa02d655 None admin] RBAC: Authorizing `identity:get_user(user_id=00607e49167d4a6d889e3541d43e3e42)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:43.740859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50447e07-ce95-4378-90d6-29ecaa02d655 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:43.742832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 107/217] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:43 2022] GET /identity/v3/users/00607e49167d4a6d889e3541d43e3e42 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:43.748562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e21a0-0b02-4bd3-be06-8590cc1a68dd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:43.863458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e21a0-0b02-4bd3-be06-8590cc1a68dd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:43.872906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:43.912391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5462c-b8f4-466a-981a-dcb10f4b1c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:43.913036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5462c-b8f4-466a-981a-dcb10f4b1c62 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:43.913344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5462c-b8f4-466a-981a-dcb10f4b1c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:43.913625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5462c-b8f4-466a-981a-dcb10f4b1c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:44.002329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5462c-b8f4-466a-981a-dcb10f4b1c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:44.003721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5462c-b8f4-466a-981a-dcb10f4b1c62 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:44.139799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 111/218] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:44.145910 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50447e07-ce95-4378-90d6-29ecaa02d655 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:44.234127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:44.254230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50447e07-ce95-4378-90d6-29ecaa02d655 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:44.302914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ec63c-b6fa-4ae7-af21-d8fd7cc8bac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:44.303589 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec63c-b6fa-4ae7-af21-d8fd7cc8bac7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:44.303871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec63c-b6fa-4ae7-af21-d8fd7cc8bac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:44.304141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec63c-b6fa-4ae7-af21-d8fd7cc8bac7 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:44.305375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ec63c-b6fa-4ae7-af21-d8fd7cc8bac7 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:44.306840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ec63c-b6fa-4ae7-af21-d8fd7cc8bac7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:44.308555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 108/219] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:44 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:44.314507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5462c-b8f4-466a-981a-dcb10f4b1c62 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:44.326032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:44.434362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5462c-b8f4-466a-981a-dcb10f4b1c62 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:44.470907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ae074-54a7-44e1-a787-76aec893612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:44.471552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae074-54a7-44e1-a787-76aec893612a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:44.471878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae074-54a7-44e1-a787-76aec893612a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:44.472154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae074-54a7-44e1-a787-76aec893612a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:44.473076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ae074-54a7-44e1-a787-76aec893612a None admin] RBAC: Adding query filter params (role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=6fe9341b7bf94c7bb282049899463dec, user.id=00607e49167d4a6d889e3541d43e3e42) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:44.473427 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ae074-54a7-44e1-a787-76aec893612a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:44.474882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ae074-54a7-44e1-a787-76aec893612a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:44.480791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 112/220] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:44 2022] GET /identity/v3/role_assignments?user.id=00607e49167d4a6d889e3541d43e3e42&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:44.555283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d279a-f266-462a-8956-630052b76de7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:44.555479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d279a-f266-462a-8956-630052b76de7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:44.555742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d279a-f266-462a-8956-630052b76de7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:44.557248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 109/221] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:44.574436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19dabe-50ad-4bd5-bb0c-3daab797e0f2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:44.574750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19dabe-50ad-4bd5-bb0c-3daab797e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:44.575000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19dabe-50ad-4bd5-bb0c-3daab797e0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:44.598396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9a19dabe-50ad-4bd5-bb0c-3daab797e0f2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:44.599634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9a19dabe-50ad-4bd5-bb0c-3daab797e0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:44.682172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 113/222] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:44.716234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d279a-f266-462a-8956-630052b76de7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:44.851219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d279a-f266-462a-8956-630052b76de7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:44.900854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82885fa7-47db-4259-89e2-9d4cfb575080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:44.901547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885fa7-47db-4259-89e2-9d4cfb575080 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:44.901822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885fa7-47db-4259-89e2-9d4cfb575080 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:44.902087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885fa7-47db-4259-89e2-9d4cfb575080 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:44.916162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82885fa7-47db-4259-89e2-9d4cfb575080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-82885fa7-47db-4259-89e2-9d4cfb575080 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:44.921359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:44.922261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:44.923447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 110/223] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:13:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:44.930454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19dabe-50ad-4bd5-bb0c-3daab797e0f2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:44.961708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:44.992619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023881db-3dc1-42d8-a6fc-24d3c29f84f3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:44.992926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023881db-3dc1-42d8-a6fc-24d3c29f84f3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:44.993159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023881db-3dc1-42d8-a6fc-24d3c29f84f3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:44.994552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 111/224] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:44.999733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04277eb-da92-4ff0-8d17-e7498210aaa1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.000014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04277eb-da92-4ff0-8d17-e7498210aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.000290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04277eb-da92-4ff0-8d17-e7498210aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.034486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e04277eb-da92-4ff0-8d17-e7498210aaa1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:45.035727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e04277eb-da92-4ff0-8d17-e7498210aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:45.036003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19dabe-50ad-4bd5-bb0c-3daab797e0f2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:45.037818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:45.071366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e86f-acce-41b7-99a1-e634f708c1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:45.072319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e86f-acce-41b7-99a1-e634f708c1bd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.072777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e86f-acce-41b7-99a1-e634f708c1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.073251 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e86f-acce-41b7-99a1-e634f708c1bd None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.074179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1e86f-acce-41b7-99a1-e634f708c1bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:45.074651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1e86f-acce-41b7-99a1-e634f708c1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:45.076201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1e86f-acce-41b7-99a1-e634f708c1bd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:45.085387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 114/225] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:13:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:45.094204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e86f-acce-41b7-99a1-e634f708c1bd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:45.185647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 112/226] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:45.203390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:45.228831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04277eb-da92-4ff0-8d17-e7498210aaa1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:45.248373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e86f-acce-41b7-99a1-e634f708c1bd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:45.284336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c7a3e-408c-40eb-a317-41472fb0f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:45.285393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c7a3e-408c-40eb-a317-41472fb0f91c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.285836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c7a3e-408c-40eb-a317-41472fb0f91c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.286239 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c7a3e-408c-40eb-a317-41472fb0f91c None admin] PATH_INFO: `/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.287565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c7a3e-408c-40eb-a317-41472fb0f91c None admin] RBAC: Authorizing `identity:get_user(user_id=00a0c18a1f1d4b4d8ebb467d29e074df)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:45.289188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c7a3e-408c-40eb-a317-41472fb0f91c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:45.290996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 115/227] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:45 2022] GET /identity/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:45.296837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c7a3e-408c-40eb-a317-41472fb0f91c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:45.402914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c7a3e-408c-40eb-a317-41472fb0f91c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:45.435182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:45.442740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716f2b8-67ae-4343-8c49-ebe90c5098bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:45.443923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716f2b8-67ae-4343-8c49-ebe90c5098bf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.444392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716f2b8-67ae-4343-8c49-ebe90c5098bf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.444805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716f2b8-67ae-4343-8c49-ebe90c5098bf None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.446170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716f2b8-67ae-4343-8c49-ebe90c5098bf None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:45.447931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716f2b8-67ae-4343-8c49-ebe90c5098bf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:45.449905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 116/228] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:45 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:45.456271 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716f2b8-67ae-4343-8c49-ebe90c5098bf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:45.489410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04277eb-da92-4ff0-8d17-e7498210aaa1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:45.558064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0e932-842f-41eb-aa9d-d4cf7ce57caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:45.558750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0e932-842f-41eb-aa9d-d4cf7ce57caa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.559023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0e932-842f-41eb-aa9d-d4cf7ce57caa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.559448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0e932-842f-41eb-aa9d-d4cf7ce57caa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.562728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716f2b8-67ae-4343-8c49-ebe90c5098bf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:45.575633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0e932-842f-41eb-aa9d-d4cf7ce57caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c3d0e932-842f-41eb-aa9d-d4cf7ce57caa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:45.581501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:45.582539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:45.583337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:45.585754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 113/229] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:13:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:13:45.589704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:45.591952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0e932-842f-41eb-aa9d-d4cf7ce57caa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:45.600724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7f922-3492-42b2-99f0-57d7d5ffd32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:45.601810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7f922-3492-42b2-99f0-57d7d5ffd32e None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.602331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7f922-3492-42b2-99f0-57d7d5ffd32e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.602835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7f922-3492-42b2-99f0-57d7d5ffd32e None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec/users/00a0c18a1f1d4b4d8ebb467d29e074df/roles/53cf1beeeaca4ae1b43e5399ce133329` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.605252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7f922-3492-42b2-99f0-57d7d5ffd32e None admin] RBAC: Authorizing `identity:create_grant(project_id=6fe9341b7bf94c7bb282049899463dec, user_id=00a0c18a1f1d4b4d8ebb467d29e074df, role_id=53cf1beeeaca4ae1b43e5399ce133329)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:45.607065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7f922-3492-42b2-99f0-57d7d5ffd32e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:45.627604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 117/230] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:13:45 2022] PUT /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec/users/00a0c18a1f1d4b4d8ebb467d29e074df/roles/53cf1beeeaca4ae1b43e5399ce133329 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:13:45.751003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0e932-842f-41eb-aa9d-d4cf7ce57caa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:45.801298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d67142-e604-4b9f-a1af-ee7fd77a5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:45.802335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d67142-e604-4b9f-a1af-ee7fd77a5044 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.802914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d67142-e604-4b9f-a1af-ee7fd77a5044 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.803376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d67142-e604-4b9f-a1af-ee7fd77a5044 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.804423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d67142-e604-4b9f-a1af-ee7fd77a5044 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:45.804935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d67142-e604-4b9f-a1af-ee7fd77a5044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:45.806590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d67142-e604-4b9f-a1af-ee7fd77a5044 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:45.821893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 114/231] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:45.827618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7f922-3492-42b2-99f0-57d7d5ffd32e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:45.895661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:45.909309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168001d-5cea-45a4-bd6d-9bd3904cfd01 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.909658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168001d-5cea-45a4-bd6d-9bd3904cfd01 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.909845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168001d-5cea-45a4-bd6d-9bd3904cfd01 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.911519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 115/232] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:45.919372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1bf9c-10bb-4588-b195-76a41e282048 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.919984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1bf9c-10bb-4588-b195-76a41e282048 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.921175 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1bf9c-10bb-4588-b195-76a41e282048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.941303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-16a1bf9c-10bb-4588-b195-76a41e282048 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:45.943198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-16a1bf9c-10bb-4588-b195-76a41e282048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:45.947803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7f922-3492-42b2-99f0-57d7d5ffd32e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:45.989290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b046-b975-4226-9d19-c4aca6f46453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:45.989290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b046-b975-4226-9d19-c4aca6f46453 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:45.989290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b046-b975-4226-9d19-c4aca6f46453 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:45.989290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b046-b975-4226-9d19-c4aca6f46453 None admin] PATH_INFO: `/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:45.989747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b046-b975-4226-9d19-c4aca6f46453 None admin] RBAC: Authorizing `identity:get_user(user_id=00a0c18a1f1d4b4d8ebb467d29e074df)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:45.989747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b046-b975-4226-9d19-c4aca6f46453 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:45.991919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 118/233] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:45 2022] GET /identity/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:46.002547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b046-b975-4226-9d19-c4aca6f46453 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:46.038430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:46.062503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 116/234] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:46.063018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be01f4-3bc2-4714-bb4d-ec84dcd3efcd None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.063302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be01f4-3bc2-4714-bb4d-ec84dcd3efcd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.063570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be01f4-3bc2-4714-bb4d-ec84dcd3efcd None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.065004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 117/235] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:46.070488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79129a6-6dae-4545-9f01-3f7ed2407bc0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.070768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79129a6-6dae-4545-9f01-3f7ed2407bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.071040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79129a6-6dae-4545-9f01-3f7ed2407bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.092075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c79129a6-6dae-4545-9f01-3f7ed2407bc0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:46.093292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c79129a6-6dae-4545-9f01-3f7ed2407bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:46.144634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b046-b975-4226-9d19-c4aca6f46453 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:46.182000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 118/236] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:46.183031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79129a6-6dae-4545-9f01-3f7ed2407bc0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:46.220096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:46.234297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8fec-7a27-413f-a9f4-28b6a4a41bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:46.236759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8fec-7a27-413f-a9f4-28b6a4a41bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.237545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8fec-7a27-413f-a9f4-28b6a4a41bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.238040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8fec-7a27-413f-a9f4-28b6a4a41bb6 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.239690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce8fec-7a27-413f-a9f4-28b6a4a41bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:46.241499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce8fec-7a27-413f-a9f4-28b6a4a41bb6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:46.243788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 119/237] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:46 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:46.244765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8fec-7a27-413f-a9f4-28b6a4a41bb6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:46.323082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79129a6-6dae-4545-9f01-3f7ed2407bc0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:46.349066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:46.366916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff540-8c96-401f-9362-1d2a90971808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:46.368001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff540-8c96-401f-9362-1d2a90971808 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.368111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8fec-7a27-413f-a9f4-28b6a4a41bb6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:46.368463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff540-8c96-401f-9362-1d2a90971808 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.368901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff540-8c96-401f-9362-1d2a90971808 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.370381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff540-8c96-401f-9362-1d2a90971808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:46.371872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff540-8c96-401f-9362-1d2a90971808 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:46.373582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 119/238] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:46.374345 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff540-8c96-401f-9362-1d2a90971808 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:46.409599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dfe71-5676-4bc7-ad84-5afd5664fa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:46.410475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dfe71-5676-4bc7-ad84-5afd5664fa51 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.410759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dfe71-5676-4bc7-ad84-5afd5664fa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.411384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dfe71-5676-4bc7-ad84-5afd5664fa51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.425186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dfe71-5676-4bc7-ad84-5afd5664fa51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8f4dfe71-5676-4bc7-ad84-5afd5664fa51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:46.431933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:46.433891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 120/239] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:46.435920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dfe71-5676-4bc7-ad84-5afd5664fa51 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:46.502588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff540-8c96-401f-9362-1d2a90971808 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:46.509064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:46.557295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a326d5-d5f9-4e05-98ee-4edf98cb9182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:46.558566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a326d5-d5f9-4e05-98ee-4edf98cb9182 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.558856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a326d5-d5f9-4e05-98ee-4edf98cb9182 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.559130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a326d5-d5f9-4e05-98ee-4edf98cb9182 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec/users/00a0c18a1f1d4b4d8ebb467d29e074df/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.562132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a326d5-d5f9-4e05-98ee-4edf98cb9182 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fe9341b7bf94c7bb282049899463dec, user_id=00a0c18a1f1d4b4d8ebb467d29e074df, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:46.564081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a326d5-d5f9-4e05-98ee-4edf98cb9182 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:46.571945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dfe71-5676-4bc7-ad84-5afd5664fa51 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:46.583397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 120/240] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:13:46 2022] PUT /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec/users/00a0c18a1f1d4b4d8ebb467d29e074df/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:13:46.584717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a326d5-d5f9-4e05-98ee-4edf98cb9182 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:46.618400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c42e8-43f0-4197-981e-52a928fa3fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:46.619110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c42e8-43f0-4197-981e-52a928fa3fce None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.619432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c42e8-43f0-4197-981e-52a928fa3fce None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.619715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c42e8-43f0-4197-981e-52a928fa3fce None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.620604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c42e8-43f0-4197-981e-52a928fa3fce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:46.622420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c42e8-43f0-4197-981e-52a928fa3fce None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:46.655266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:46.682889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 121/241] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:13:46 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:46.742880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a326d5-d5f9-4e05-98ee-4edf98cb9182 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:46.792680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172429a-2df9-4ba5-b099-8082bcb3e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:46.793765 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172429a-2df9-4ba5-b099-8082bcb3e976 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.794251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172429a-2df9-4ba5-b099-8082bcb3e976 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.794767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172429a-2df9-4ba5-b099-8082bcb3e976 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.795744 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172429a-2df9-4ba5-b099-8082bcb3e976 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:46.796266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172429a-2df9-4ba5-b099-8082bcb3e976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:46.797982 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172429a-2df9-4ba5-b099-8082bcb3e976 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:46.808603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 121/242] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:46.814794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c42e8-43f0-4197-981e-52a928fa3fce None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:46.878538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a772cf-7ea8-429e-a3b2-3f76c3b2eb79 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.878717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a772cf-7ea8-429e-a3b2-3f76c3b2eb79 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.879062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a772cf-7ea8-429e-a3b2-3f76c3b2eb79 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.880653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 122/243] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:46.887794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492810b-446e-436d-973d-f2bb0b0de977 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.888103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492810b-446e-436d-973d-f2bb0b0de977 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:46.888342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492810b-446e-436d-973d-f2bb0b0de977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:46.913386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6492810b-446e-436d-973d-f2bb0b0de977 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:46.914638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6492810b-446e-436d-973d-f2bb0b0de977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:46.953810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c42e8-43f0-4197-981e-52a928fa3fce None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:46.972507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:46.998998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6782ced-f096-4d66-aec4-344de30bf689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:46.999706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6782ced-f096-4d66-aec4-344de30bf689 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:46.999945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6782ced-f096-4d66-aec4-344de30bf689 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:47.000216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6782ced-f096-4d66-aec4-344de30bf689 None admin] PATH_INFO: `/v3/users/c6c329b38e3b4697b109e2cb5d88c683` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:47.019448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6782ced-f096-4d66-aec4-344de30bf689 None admin] RBAC: Authorizing `identity:get_user(user_id=c6c329b38e3b4697b109e2cb5d88c683)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:47.021015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6782ced-f096-4d66-aec4-344de30bf689 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:47.023136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 122/244] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:46 2022] GET /identity/v3/users/c6c329b38e3b4697b109e2cb5d88c683 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:47.030715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6782ced-f096-4d66-aec4-344de30bf689 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:47.056066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 123/245] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:47.084132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492810b-446e-436d-973d-f2bb0b0de977 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:47.141111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:47.174014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6782ced-f096-4d66-aec4-344de30bf689 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:47.210640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492810b-446e-436d-973d-f2bb0b0de977 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:47.211407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106cc4-9793-43ad-ad6b-82c00e8bb3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:47.212047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106cc4-9793-43ad-ad6b-82c00e8bb3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:47.212322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106cc4-9793-43ad-ad6b-82c00e8bb3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:47.212589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106cc4-9793-43ad-ad6b-82c00e8bb3f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:47.254107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:47.255065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a110b2-e188-4073-b821-fd194fa3c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:47.256026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a110b2-e188-4073-b821-fd194fa3c850 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:47.256413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a110b2-e188-4073-b821-fd194fa3c850 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:47.256761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a110b2-e188-4073-b821-fd194fa3c850 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:47.272998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a110b2-e188-4073-b821-fd194fa3c850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a1a110b2-e188-4073-b821-fd194fa3c850 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:47.279388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:47.280358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:47.281276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 124/246] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:13:47.287425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0106cc4-9793-43ad-ad6b-82c00e8bb3f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:47.288930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0106cc4-9793-43ad-ad6b-82c00e8bb3f5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:47.301140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a110b2-e188-4073-b821-fd194fa3c850 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:47.392119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 123/247] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:47.397609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106cc4-9793-43ad-ad6b-82c00e8bb3f5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:47.418623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:47.423866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a110b2-e188-4073-b821-fd194fa3c850 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:47.470330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeac965-562d-4915-b9c2-72a2480bf882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:47.471252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeac965-562d-4915-b9c2-72a2480bf882 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:47.471683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeac965-562d-4915-b9c2-72a2480bf882 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:47.472089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeac965-562d-4915-b9c2-72a2480bf882 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:47.473035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeac965-562d-4915-b9c2-72a2480bf882 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:47.473497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeac965-562d-4915-b9c2-72a2480bf882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:47.475065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeac965-562d-4915-b9c2-72a2480bf882 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:47.486730 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 125/248] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:47.493286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeac965-562d-4915-b9c2-72a2480bf882 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:47.527730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:47.591716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106cc4-9793-43ad-ad6b-82c00e8bb3f5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:47.677904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5323b7-c50a-4721-98a1-0638505cfaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:47.678510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5323b7-c50a-4721-98a1-0638505cfaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:47.678794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5323b7-c50a-4721-98a1-0638505cfaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:47.679068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5323b7-c50a-4721-98a1-0638505cfaa7 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:47.683925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5323b7-c50a-4721-98a1-0638505cfaa7 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:47.685503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5323b7-c50a-4721-98a1-0638505cfaa7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:47.687386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 124/249] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:47 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:47.702395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5323b7-c50a-4721-98a1-0638505cfaa7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:47.713505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeac965-562d-4915-b9c2-72a2480bf882 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:47.790961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac67d6-a03b-4eec-958c-ccab133485dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:47.791687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac67d6-a03b-4eec-958c-ccab133485dd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:47.791961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac67d6-a03b-4eec-958c-ccab133485dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:47.792242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac67d6-a03b-4eec-958c-ccab133485dd None admin] PATH_INFO: `/v3/users/00607e49167d4a6d889e3541d43e3e42` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:47.797586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac67d6-a03b-4eec-958c-ccab133485dd None admin] RBAC: Authorizing `identity:get_user(user_id=00607e49167d4a6d889e3541d43e3e42)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:47.799072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac67d6-a03b-4eec-958c-ccab133485dd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:47.801157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 126/250] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:47 2022] GET /identity/v3/users/00607e49167d4a6d889e3541d43e3e42 => generated 297 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:47.807469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac67d6-a03b-4eec-958c-ccab133485dd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:47.877720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:47.945646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5323b7-c50a-4721-98a1-0638505cfaa7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:48.037275 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac67d6-a03b-4eec-958c-ccab133485dd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:48.038021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd89f59-58c1-4cfc-ac89-84bb36745bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:48.038683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd89f59-58c1-4cfc-ac89-84bb36745bfc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:48.038969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd89f59-58c1-4cfc-ac89-84bb36745bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:48.039248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd89f59-58c1-4cfc-ac89-84bb36745bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:48.040065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd89f59-58c1-4cfc-ac89-84bb36745bfc None admin] RBAC: Adding query filter params (role.id=d2c3206fe0a4419283e432c1f5e555e6, scope.project.id=6fe9341b7bf94c7bb282049899463dec, user.id=c6c329b38e3b4697b109e2cb5d88c683) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:48.040376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd89f59-58c1-4cfc-ac89-84bb36745bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:48.041865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd89f59-58c1-4cfc-ac89-84bb36745bfc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:48.053953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 125/251] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:47 2022] GET /identity/v3/role_assignments?user.id=c6c329b38e3b4697b109e2cb5d88c683&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=d2c3206fe0a4419283e432c1f5e555e6 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:48.110218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc275f32-2ad1-40f6-8533-7781bc9558bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:48.110945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc275f32-2ad1-40f6-8533-7781bc9558bc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:48.111217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc275f32-2ad1-40f6-8533-7781bc9558bc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:48.111486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc275f32-2ad1-40f6-8533-7781bc9558bc None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:48.112899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc275f32-2ad1-40f6-8533-7781bc9558bc None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:48.114464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc275f32-2ad1-40f6-8533-7781bc9558bc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:48.116485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 127/252] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:47 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:48.122502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd89f59-58c1-4cfc-ac89-84bb36745bfc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:48.127872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:48.266567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd89f59-58c1-4cfc-ac89-84bb36745bfc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:48.287306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ccd7-2894-4dc3-b149-081bd2515640 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:48.287944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ccd7-2894-4dc3-b149-081bd2515640 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:48.288409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ccd7-2894-4dc3-b149-081bd2515640 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:48.290420 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 128/253] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:48.296616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f676af-cad5-4999-8479-f4076f2d6bbb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:48.297485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f676af-cad5-4999-8479-f4076f2d6bbb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:48.297979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f676af-cad5-4999-8479-f4076f2d6bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:48.321236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-24f676af-cad5-4999-8479-f4076f2d6bbb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:48.323331 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-24f676af-cad5-4999-8479-f4076f2d6bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:48.336896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10d25c-fe6b-4128-af3d-ddc5c0eb5bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:48.337632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d25c-fe6b-4128-af3d-ddc5c0eb5bcc None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:48.337920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d25c-fe6b-4128-af3d-ddc5c0eb5bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:48.338191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d25c-fe6b-4128-af3d-ddc5c0eb5bcc None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec/users/00607e49167d4a6d889e3541d43e3e42/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:48.340257 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10d25c-fe6b-4128-af3d-ddc5c0eb5bcc None admin] RBAC: Authorizing `identity:create_grant(project_id=6fe9341b7bf94c7bb282049899463dec, user_id=00607e49167d4a6d889e3541d43e3e42, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:48.341862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10d25c-fe6b-4128-af3d-ddc5c0eb5bcc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:48.369291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 126/254] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:13:48 2022] PUT /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec/users/00607e49167d4a6d889e3541d43e3e42/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:13:48.415285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 129/255] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:48.438547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10d25c-fe6b-4128-af3d-ddc5c0eb5bcc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:48.528355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:48.582145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10d25c-fe6b-4128-af3d-ddc5c0eb5bcc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:48.619788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd633a9-27e6-4ff2-8d1f-2fe0f2b25f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:48.620461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd633a9-27e6-4ff2-8d1f-2fe0f2b25f7b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:48.620743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd633a9-27e6-4ff2-8d1f-2fe0f2b25f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:48.621020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd633a9-27e6-4ff2-8d1f-2fe0f2b25f7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:48.644588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd633a9-27e6-4ff2-8d1f-2fe0f2b25f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6bd633a9-27e6-4ff2-8d1f-2fe0f2b25f7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:48.650858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:48.651783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:48.652579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 127/256] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:13:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:48.662511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f676af-cad5-4999-8479-f4076f2d6bbb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:48.698524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:48.794584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f676af-cad5-4999-8479-f4076f2d6bbb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:48.829975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dae21-b867-4005-ab5e-bb3e0ad93ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:48.830617 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dae21-b867-4005-ab5e-bb3e0ad93ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:48.830943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dae21-b867-4005-ab5e-bb3e0ad93ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:48.831220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dae21-b867-4005-ab5e-bb3e0ad93ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:48.831982 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dae21-b867-4005-ab5e-bb3e0ad93ad6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:48.832298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dae21-b867-4005-ab5e-bb3e0ad93ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:48.833733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dae21-b867-4005-ab5e-bb3e0ad93ad6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:48.842653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 130/257] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:13:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:48.848551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd633a9-27e6-4ff2-8d1f-2fe0f2b25f7b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:49.016133 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd633a9-27e6-4ff2-8d1f-2fe0f2b25f7b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:49.048116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:49.059773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72526892-be91-4bc2-a289-ee8ac3814a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:49.060447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72526892-be91-4bc2-a289-ee8ac3814a45 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:49.065691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72526892-be91-4bc2-a289-ee8ac3814a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:49.065980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72526892-be91-4bc2-a289-ee8ac3814a45 None admin] PATH_INFO: `/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:49.067452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72526892-be91-4bc2-a289-ee8ac3814a45 None admin] RBAC: Authorizing `identity:get_user(user_id=00a0c18a1f1d4b4d8ebb467d29e074df)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:49.068960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72526892-be91-4bc2-a289-ee8ac3814a45 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:49.071003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 128/258] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:48 2022] GET /identity/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:49.076413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dae21-b867-4005-ab5e-bb3e0ad93ad6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:49.217067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dae21-b867-4005-ab5e-bb3e0ad93ad6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:49.219096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:49.255011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578d0a-2af9-405b-ac37-5ba4773be181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:49.255666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578d0a-2af9-405b-ac37-5ba4773be181 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:49.255945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578d0a-2af9-405b-ac37-5ba4773be181 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:49.256219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578d0a-2af9-405b-ac37-5ba4773be181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:49.327559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578d0a-2af9-405b-ac37-5ba4773be181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:49.329027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578d0a-2af9-405b-ac37-5ba4773be181 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:49.429663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:49.433445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 131/259] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:49.438285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72526892-be91-4bc2-a289-ee8ac3814a45 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:49.543172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72526892-be91-4bc2-a289-ee8ac3814a45 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:49.578481 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea619b0-3871-486c-8c58-a50c290fb487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:49.579066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea619b0-3871-486c-8c58-a50c290fb487 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:49.579347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea619b0-3871-486c-8c58-a50c290fb487 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:49.579617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea619b0-3871-486c-8c58-a50c290fb487 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:49.580879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea619b0-3871-486c-8c58-a50c290fb487 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:49.582559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea619b0-3871-486c-8c58-a50c290fb487 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:49.589297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 129/260] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:49 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:49.590760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578d0a-2af9-405b-ac37-5ba4773be181 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:49.696489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578d0a-2af9-405b-ac37-5ba4773be181 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:49.738746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f311f50-41d5-4bbd-8f40-a24504ae1e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:49.739400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311f50-41d5-4bbd-8f40-a24504ae1e65 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:49.739676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311f50-41d5-4bbd-8f40-a24504ae1e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:49.739947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311f50-41d5-4bbd-8f40-a24504ae1e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:49.740762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f311f50-41d5-4bbd-8f40-a24504ae1e65 None admin] RBAC: Adding query filter params (role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=6fe9341b7bf94c7bb282049899463dec, user.id=00a0c18a1f1d4b4d8ebb467d29e074df) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:49.741076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f311f50-41d5-4bbd-8f40-a24504ae1e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:49.742567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f311f50-41d5-4bbd-8f40-a24504ae1e65 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:49.749595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 132/261] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:49 2022] GET /identity/v3/role_assignments?user.id=00a0c18a1f1d4b4d8ebb467d29e074df&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:49.797849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc1a91-ee52-49b8-909b-33779668b0e8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:49.798173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc1a91-ee52-49b8-909b-33779668b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:49.798403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc1a91-ee52-49b8-909b-33779668b0e8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:49.799817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 130/262] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:49.805649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d093c2-4b54-495d-a98d-135dbfde7887 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:49.805933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d093c2-4b54-495d-a98d-135dbfde7887 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:49.806210 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d093c2-4b54-495d-a98d-135dbfde7887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:49.830488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-94d093c2-4b54-495d-a98d-135dbfde7887 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:49.831654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-94d093c2-4b54-495d-a98d-135dbfde7887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:49.889131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:49.908000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 133/263] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:49.951209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc1a91-ee52-49b8-909b-33779668b0e8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:50.018196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:50.042196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33451d8f-fdbc-4fc2-a68f-b3536dbfa8d8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.042699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33451d8f-fdbc-4fc2-a68f-b3536dbfa8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.043199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33451d8f-fdbc-4fc2-a68f-b3536dbfa8d8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:50.045871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 134/264] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:50.051974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66ebc-02bf-407f-aa28-af8664daecd8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.052602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66ebc-02bf-407f-aa28-af8664daecd8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.053076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66ebc-02bf-407f-aa28-af8664daecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:50.089376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc1a91-ee52-49b8-909b-33779668b0e8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:50.102505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c3e66ebc-02bf-407f-aa28-af8664daecd8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:50.104155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c3e66ebc-02bf-407f-aa28-af8664daecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:50.124385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41866f3-d45c-4246-9255-2b44ba820dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:50.125490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41866f3-d45c-4246-9255-2b44ba820dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.125949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41866f3-d45c-4246-9255-2b44ba820dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.126372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41866f3-d45c-4246-9255-2b44ba820dd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:50.140468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41866f3-d45c-4246-9255-2b44ba820dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c41866f3-d45c-4246-9255-2b44ba820dd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:50.146063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:50.147012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:13:50.147808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:50.149935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 131/265] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:50.157709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41866f3-d45c-4246-9255-2b44ba820dd0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:50.240635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 135/266] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:50.273393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66ebc-02bf-407f-aa28-af8664daecd8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:50.396432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66ebc-02bf-407f-aa28-af8664daecd8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:50.407325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41866f3-d45c-4246-9255-2b44ba820dd0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:50.414622 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:50.439336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab73f7-31e3-4101-b837-68436a8b6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:50.440519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab73f7-31e3-4101-b837-68436a8b6648 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.441020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab73f7-31e3-4101-b837-68436a8b6648 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.441606 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab73f7-31e3-4101-b837-68436a8b6648 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:50.443027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab73f7-31e3-4101-b837-68436a8b6648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:50.445065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab73f7-31e3-4101-b837-68436a8b6648 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:50.450667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 136/267] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:50.451048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:50.454377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab73f7-31e3-4101-b837-68436a8b6648 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:50.474909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a6ca-2ae3-4bd9-aaaa-8ab4eea3622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:50.475560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a6ca-2ae3-4bd9-aaaa-8ab4eea3622c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.475842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a6ca-2ae3-4bd9-aaaa-8ab4eea3622c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.476144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a6ca-2ae3-4bd9-aaaa-8ab4eea3622c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:50.476856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1a6ca-2ae3-4bd9-aaaa-8ab4eea3622c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:50.477161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1a6ca-2ae3-4bd9-aaaa-8ab4eea3622c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:50.479346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1a6ca-2ae3-4bd9-aaaa-8ab4eea3622c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:50.488421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 132/268] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:50.495166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a6ca-2ae3-4bd9-aaaa-8ab4eea3622c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:50.598638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab73f7-31e3-4101-b837-68436a8b6648 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:50.632490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a6ca-2ae3-4bd9-aaaa-8ab4eea3622c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:50.657562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206375-9496-415b-859a-6a5eb9814a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:50.658126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206375-9496-415b-859a-6a5eb9814a46 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.658408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206375-9496-415b-859a-6a5eb9814a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.658685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206375-9496-415b-859a-6a5eb9814a46 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:50.659409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2206375-9496-415b-859a-6a5eb9814a46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:50.661020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2206375-9496-415b-859a-6a5eb9814a46 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:50.676419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5076f92-5e6b-462c-bb3d-07f46c81537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:50.677603 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076f92-5e6b-462c-bb3d-07f46c81537a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.678099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076f92-5e6b-462c-bb3d-07f46c81537a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.678523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076f92-5e6b-462c-bb3d-07f46c81537a None admin] PATH_INFO: `/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:50.680101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5076f92-5e6b-462c-bb3d-07f46c81537a None admin] RBAC: Authorizing `identity:get_user(user_id=00a0c18a1f1d4b4d8ebb467d29e074df)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:50.681552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5076f92-5e6b-462c-bb3d-07f46c81537a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:50.688228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 133/269] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:50 2022] GET /identity/v3/users/00a0c18a1f1d4b4d8ebb467d29e074df => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:50.689771 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24766e6d-5b2b-4363-bdde-f1ce11ce7583 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.690060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24766e6d-5b2b-4363-bdde-f1ce11ce7583 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.690333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24766e6d-5b2b-4363-bdde-f1ce11ce7583 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:50.691844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 134/270] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:50.692292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 137/271] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:13:50 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:50.697499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24766e6d-5b2b-4363-bdde-f1ce11ce7583 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:50.700945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c5d98-84f6-4575-a222-f5f734015d1e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.701969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c5d98-84f6-4575-a222-f5f734015d1e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.702480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c5d98-84f6-4575-a222-f5f734015d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:50.732709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5b6c5d98-84f6-4575-a222-f5f734015d1e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:50.737433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b6c5d98-84f6-4575-a222-f5f734015d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:50.781009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:50.813304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:50.883442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24766e6d-5b2b-4363-bdde-f1ce11ce7583 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:50.894064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 138/272] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:50.922611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c5d98-84f6-4575-a222-f5f734015d1e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:50.950861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27719e-0cf0-40fa-a1e3-bb4f18b149d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:50.952357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27719e-0cf0-40fa-a1e3-bb4f18b149d1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:50.952852 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27719e-0cf0-40fa-a1e3-bb4f18b149d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:50.953375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27719e-0cf0-40fa-a1e3-bb4f18b149d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.055144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27719e-0cf0-40fa-a1e3-bb4f18b149d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:51.057202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27719e-0cf0-40fa-a1e3-bb4f18b149d1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:51.060623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c5d98-84f6-4575-a222-f5f734015d1e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:51.103853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423cd40-5ad0-4ac3-810e-3e2c3881bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:51.104527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423cd40-5ad0-4ac3-810e-3e2c3881bff1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.104802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423cd40-5ad0-4ac3-810e-3e2c3881bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.105068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423cd40-5ad0-4ac3-810e-3e2c3881bff1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.121913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423cd40-5ad0-4ac3-810e-3e2c3881bff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c423cd40-5ad0-4ac3-810e-3e2c3881bff1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:51.128549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:51.130425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:51.131757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 139/273] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:13:51.131851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5620248-dc28-4e50-9a12-c34cd8edae13 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.132117 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5620248-dc28-4e50-9a12-c34cd8edae13 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.132368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5620248-dc28-4e50-9a12-c34cd8edae13 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.133670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 140/274] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:51.137021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5620248-dc28-4e50-9a12-c34cd8edae13 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:51.139458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:51.172968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:51.216536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 135/275] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:51.218230 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bba0-ee69-4a1b-9a44-821653040908 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.219057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bba0-ee69-4a1b-9a44-821653040908 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.219585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bba0-ee69-4a1b-9a44-821653040908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.244370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9268bba0-ee69-4a1b-9a44-821653040908 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:51.244593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9268bba0-ee69-4a1b-9a44-821653040908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:51.275697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5620248-dc28-4e50-9a12-c34cd8edae13 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:51.312685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea949072-f0c2-4dcb-83c1-bc4f4711fc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:51.313355 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea949072-f0c2-4dcb-83c1-bc4f4711fc6f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.313632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea949072-f0c2-4dcb-83c1-bc4f4711fc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.313907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea949072-f0c2-4dcb-83c1-bc4f4711fc6f None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.314645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea949072-f0c2-4dcb-83c1-bc4f4711fc6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:51.314998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea949072-f0c2-4dcb-83c1-bc4f4711fc6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:51.316538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea949072-f0c2-4dcb-83c1-bc4f4711fc6f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:51.318924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 136/276] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:51.320089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bba0-ee69-4a1b-9a44-821653040908 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:51.326519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 141/277] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:51.332153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea949072-f0c2-4dcb-83c1-bc4f4711fc6f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:51.416339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:51.439495 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:51.440181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bba0-ee69-4a1b-9a44-821653040908 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:51.450957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea949072-f0c2-4dcb-83c1-bc4f4711fc6f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:51.479188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404dc5d-e39f-4f32-9b85-da5d2c57cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:51.480109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404dc5d-e39f-4f32-9b85-da5d2c57cafa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.480388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404dc5d-e39f-4f32-9b85-da5d2c57cafa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.480662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404dc5d-e39f-4f32-9b85-da5d2c57cafa None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.482516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404dc5d-e39f-4f32-9b85-da5d2c57cafa None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:51.484508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404dc5d-e39f-4f32-9b85-da5d2c57cafa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:51.487414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 137/278] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:51 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:51.488388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404dc5d-e39f-4f32-9b85-da5d2c57cafa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:51.494714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e9178-52ba-49ef-af1e-237b2dc17886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:51.495400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e9178-52ba-49ef-af1e-237b2dc17886 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.495681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e9178-52ba-49ef-af1e-237b2dc17886 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.495955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e9178-52ba-49ef-af1e-237b2dc17886 None admin] PATH_INFO: `/v3/users/6b77d40b68214592ab5a20edf0f51a2f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.515073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e9178-52ba-49ef-af1e-237b2dc17886 None admin] RBAC: Authorizing `identity:get_user(user_id=6b77d40b68214592ab5a20edf0f51a2f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:51.516926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e9178-52ba-49ef-af1e-237b2dc17886 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:51.520085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 142/279] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:51 2022] GET /identity/v3/users/6b77d40b68214592ab5a20edf0f51a2f => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:51.526133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004f831-31c7-4953-93a5-6302b5605b20 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.526334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004f831-31c7-4953-93a5-6302b5605b20 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.526573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004f831-31c7-4953-93a5-6302b5605b20 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.528012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 143/280] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:51.529189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004f831-31c7-4953-93a5-6302b5605b20 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:51.611666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404dc5d-e39f-4f32-9b85-da5d2c57cafa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:51.642518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004f831-31c7-4953-93a5-6302b5605b20 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:51.650825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da2e05-bcc8-46a0-916d-cf3402d686fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:51.651806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da2e05-bcc8-46a0-916d-cf3402d686fb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.652375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da2e05-bcc8-46a0-916d-cf3402d686fb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.652839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da2e05-bcc8-46a0-916d-cf3402d686fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.670091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da2e05-bcc8-46a0-916d-cf3402d686fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e2da2e05-bcc8-46a0-916d-cf3402d686fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:51.680329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:51.681525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:51.682349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:51.682971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37136b4f-ac74-4a50-b1e5-1c6cff78808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:51.682971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37136b4f-ac74-4a50-b1e5-1c6cff78808f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.682971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37136b4f-ac74-4a50-b1e5-1c6cff78808f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.682971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37136b4f-ac74-4a50-b1e5-1c6cff78808f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.683797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37136b4f-ac74-4a50-b1e5-1c6cff78808f None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=6fe9341b7bf94c7bb282049899463dec, user.id=00a0c18a1f1d4b4d8ebb467d29e074df) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:51.683797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37136b4f-ac74-4a50-b1e5-1c6cff78808f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:51.685012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37136b4f-ac74-4a50-b1e5-1c6cff78808f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:51.685975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 138/281] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:51.687433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da2e05-bcc8-46a0-916d-cf3402d686fb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:51.697411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 144/282] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:51 2022] GET /identity/v3/role_assignments?user.id=00a0c18a1f1d4b4d8ebb467d29e074df&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:51.698893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827e33-afb1-48fa-8c61-b0a6d2aef75d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.699185 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827e33-afb1-48fa-8c61-b0a6d2aef75d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.699464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827e33-afb1-48fa-8c61-b0a6d2aef75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.709289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:51.743432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-70827e33-afb1-48fa-8c61-b0a6d2aef75d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:51.743970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-70827e33-afb1-48fa-8c61-b0a6d2aef75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:51.762600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:51.835510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da2e05-bcc8-46a0-916d-cf3402d686fb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:51.893539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079252fc-e232-4a18-b1b4-6e6c02ddd762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:51.894638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079252fc-e232-4a18-b1b4-6e6c02ddd762 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:51.894923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079252fc-e232-4a18-b1b4-6e6c02ddd762 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:51.895196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079252fc-e232-4a18-b1b4-6e6c02ddd762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:51.896022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079252fc-e232-4a18-b1b4-6e6c02ddd762 None admin] RBAC: Adding query filter params (role.id=c0c80af8168f45fc9fffd24abe0136f3, user.id=6b77d40b68214592ab5a20edf0f51a2f, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:51.896330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079252fc-e232-4a18-b1b4-6e6c02ddd762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:51.898515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079252fc-e232-4a18-b1b4-6e6c02ddd762 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:51.905315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 139/283] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 26 07:13:51 2022] GET /identity/v3/role_assignments?user.id=6b77d40b68214592ab5a20edf0f51a2f&scope.system=all&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:51.906723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079252fc-e232-4a18-b1b4-6e6c02ddd762 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:51.919979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 145/284] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:51.954273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70827e33-afb1-48fa-8c61-b0a6d2aef75d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:52.003593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:52.054717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079252fc-e232-4a18-b1b4-6e6c02ddd762 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:52.104551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ed2c-829c-46bc-b816-5082fa0fc91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:52.105205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ed2c-829c-46bc-b816-5082fa0fc91e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:52.105516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ed2c-829c-46bc-b816-5082fa0fc91e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:52.105792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ed2c-829c-46bc-b816-5082fa0fc91e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:52.107137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1ed2c-829c-46bc-b816-5082fa0fc91e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:52.107446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1ed2c-829c-46bc-b816-5082fa0fc91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:52.108909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1ed2c-829c-46bc-b816-5082fa0fc91e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:52.119893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 140/285] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:52.126423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ed2c-829c-46bc-b816-5082fa0fc91e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:52.205035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70827e33-afb1-48fa-8c61-b0a6d2aef75d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:52.238172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ed2c-829c-46bc-b816-5082fa0fc91e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:52.268343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bef4ad-b488-4b7f-814e-3f19a03c97d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:52.269026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bef4ad-b488-4b7f-814e-3f19a03c97d0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:52.269334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bef4ad-b488-4b7f-814e-3f19a03c97d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:52.269669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bef4ad-b488-4b7f-814e-3f19a03c97d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:52.283931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bef4ad-b488-4b7f-814e-3f19a03c97d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-46bef4ad-b488-4b7f-814e-3f19a03c97d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:52.290213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:52.291137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:52.291936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 146/286] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:52.299909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bef4ad-b488-4b7f-814e-3f19a03c97d0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:52.304014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:52.305304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:52.318228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23bffb-11e3-4f2f-968d-91c961580278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:52.318905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23bffb-11e3-4f2f-968d-91c961580278 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:52.319361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23bffb-11e3-4f2f-968d-91c961580278 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:52.319644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23bffb-11e3-4f2f-968d-91c961580278 None admin] PATH_INFO: `/v3/users/c6c329b38e3b4697b109e2cb5d88c683` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:52.322018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23bffb-11e3-4f2f-968d-91c961580278 None admin] RBAC: Authorizing `identity:get_user(user_id=c6c329b38e3b4697b109e2cb5d88c683)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:52.323509 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23bffb-11e3-4f2f-968d-91c961580278 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:52.325743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 141/287] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:52 2022] GET /identity/v3/users/c6c329b38e3b4697b109e2cb5d88c683 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:52.334469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23bffb-11e3-4f2f-968d-91c961580278 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:52.504179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bef4ad-b488-4b7f-814e-3f19a03c97d0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:52.531168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23bffb-11e3-4f2f-968d-91c961580278 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:52.554703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04948cde-17e5-4283-a1f8-9b30c28378d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:52.555352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04948cde-17e5-4283-a1f8-9b30c28378d9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:52.555630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04948cde-17e5-4283-a1f8-9b30c28378d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:52.555901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04948cde-17e5-4283-a1f8-9b30c28378d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:52.556640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04948cde-17e5-4283-a1f8-9b30c28378d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:52.556946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04948cde-17e5-4283-a1f8-9b30c28378d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:52.558381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04948cde-17e5-4283-a1f8-9b30c28378d9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:52.572113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6cb66-2ab5-4fbb-b282-744b83d48ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:52.573129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6cb66-2ab5-4fbb-b282-744b83d48ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:52.573635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6cb66-2ab5-4fbb-b282-744b83d48ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:52.574105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6cb66-2ab5-4fbb-b282-744b83d48ae4 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:52.575634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6cb66-2ab5-4fbb-b282-744b83d48ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:52.578780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6cb66-2ab5-4fbb-b282-744b83d48ae4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:52.579548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 147/288] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:52.581678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 142/289] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:52 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:52.587522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04948cde-17e5-4283-a1f8-9b30c28378d9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:52.591473 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6cb66-2ab5-4fbb-b282-744b83d48ae4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:52.706819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:52.748348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04948cde-17e5-4283-a1f8-9b30c28378d9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:52.760175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:52.794450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1f3f8-f24b-4411-b926-27febde74e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:52.795152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1f3f8-f24b-4411-b926-27febde74e06 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:52.795432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1f3f8-f24b-4411-b926-27febde74e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:52.795700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1f3f8-f24b-4411-b926-27febde74e06 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec/users/c6c329b38e3b4697b109e2cb5d88c683/roles/d2c3206fe0a4419283e432c1f5e555e6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:52.800727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1f3f8-f24b-4411-b926-27febde74e06 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fe9341b7bf94c7bb282049899463dec, user_id=c6c329b38e3b4697b109e2cb5d88c683, role_id=d2c3206fe0a4419283e432c1f5e555e6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:52.802254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1f3f8-f24b-4411-b926-27febde74e06 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:52.822200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6cb66-2ab5-4fbb-b282-744b83d48ae4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:52.826089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 148/290] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:13:52 2022] PUT /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec/users/c6c329b38e3b4697b109e2cb5d88c683/roles/d2c3206fe0a4419283e432c1f5e555e6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:13:52.873326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fe1c3-0c89-43df-8671-e6ab46e2014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:52.874007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fe1c3-0c89-43df-8671-e6ab46e2014c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:52.874285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fe1c3-0c89-43df-8671-e6ab46e2014c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:52.874560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fe1c3-0c89-43df-8671-e6ab46e2014c None admin] PATH_INFO: `/v3/users/00607e49167d4a6d889e3541d43e3e42` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:52.875923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fe1c3-0c89-43df-8671-e6ab46e2014c None admin] RBAC: Authorizing `identity:get_user(user_id=00607e49167d4a6d889e3541d43e3e42)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:52.877716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fe1c3-0c89-43df-8671-e6ab46e2014c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:52.880491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 143/291] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:52 2022] GET /identity/v3/users/00607e49167d4a6d889e3541d43e3e42 => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:52.886883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1f3f8-f24b-4411-b926-27febde74e06 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:53.032211 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1f3f8-f24b-4411-b926-27febde74e06 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:53.057858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:53.073314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6cee4b-1fb7-4b66-a5b1-cd9011197a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:53.073991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cee4b-1fb7-4b66-a5b1-cd9011197a00 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:53.074272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cee4b-1fb7-4b66-a5b1-cd9011197a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:53.074548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cee4b-1fb7-4b66-a5b1-cd9011197a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:53.165506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6cee4b-1fb7-4b66-a5b1-cd9011197a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:53.167135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6cee4b-1fb7-4b66-a5b1-cd9011197a00 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:53.289249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 149/292] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:53.294940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fe1c3-0c89-43df-8671-e6ab46e2014c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:53.438466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fe1c3-0c89-43df-8671-e6ab46e2014c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:53.466069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187b75-ac2c-4a9d-b521-00c7324c8a68 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:53.466502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187b75-ac2c-4a9d-b521-00c7324c8a68 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:53.466652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187b75-ac2c-4a9d-b521-00c7324c8a68 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:53.468413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 150/293] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:53.474382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8046d0f-4fd9-4cae-b89e-1bddcbcd6a66 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:53.474760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8046d0f-4fd9-4cae-b89e-1bddcbcd6a66 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:53.474911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8046d0f-4fd9-4cae-b89e-1bddcbcd6a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:53.512801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933abeff-be51-45f7-976c-2adab43aa659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:53.513899 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933abeff-be51-45f7-976c-2adab43aa659 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:53.514381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933abeff-be51-45f7-976c-2adab43aa659 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:53.514856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933abeff-be51-45f7-976c-2adab43aa659 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:53.516916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933abeff-be51-45f7-976c-2adab43aa659 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:53.518308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d8046d0f-4fd9-4cae-b89e-1bddcbcd6a66 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:53.519572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d8046d0f-4fd9-4cae-b89e-1bddcbcd6a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:53.519727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933abeff-be51-45f7-976c-2adab43aa659 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:53.523498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 144/294] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:53 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:53.530945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933abeff-be51-45f7-976c-2adab43aa659 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:53.549833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:53.550138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:53.607857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 151/295] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:53.631576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8046d0f-4fd9-4cae-b89e-1bddcbcd6a66 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:53.739419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8046d0f-4fd9-4cae-b89e-1bddcbcd6a66 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:53.782531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933abeff-be51-45f7-976c-2adab43aa659 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:53.815122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ae539-b30b-4b67-9a7e-4888a580a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:53.815763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ae539-b30b-4b67-9a7e-4888a580a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:53.816030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ae539-b30b-4b67-9a7e-4888a580a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:53.816339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ae539-b30b-4b67-9a7e-4888a580a3e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:53.822685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40847d65-9e5a-4c6e-8a44-9a1360ebba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:53.823586 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40847d65-9e5a-4c6e-8a44-9a1360ebba5c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:53.823861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40847d65-9e5a-4c6e-8a44-9a1360ebba5c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:53.824131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40847d65-9e5a-4c6e-8a44-9a1360ebba5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:53.825017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40847d65-9e5a-4c6e-8a44-9a1360ebba5c None admin] RBAC: Adding query filter params (role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=6fe9341b7bf94c7bb282049899463dec, user.id=00607e49167d4a6d889e3541d43e3e42) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:53.825354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40847d65-9e5a-4c6e-8a44-9a1360ebba5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:53.827301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40847d65-9e5a-4c6e-8a44-9a1360ebba5c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:53.834049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 145/296] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:53 2022] GET /identity/v3/role_assignments?user.id=00607e49167d4a6d889e3541d43e3e42&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:53.854092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ae539-b30b-4b67-9a7e-4888a580a3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2d6ae539-b30b-4b67-9a7e-4888a580a3e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:53.860361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:53.861647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:53.862475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 152/297] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:53.868324 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40847d65-9e5a-4c6e-8a44-9a1360ebba5c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:53.989624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7045-a79b-46db-9006-4e8746acc00f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:53.989992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7045-a79b-46db-9006-4e8746acc00f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:53.990181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7045-a79b-46db-9006-4e8746acc00f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:53.992087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 153/298] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:53.998103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755c53-4cdd-423e-92e8-e1145518d92d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:53.998448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755c53-4cdd-423e-92e8-e1145518d92d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:53.998656 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755c53-4cdd-423e-92e8-e1145518d92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:54.015732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:54.022679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d3755c53-4cdd-423e-92e8-e1145518d92d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:54.023828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d3755c53-4cdd-423e-92e8-e1145518d92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:54.038264 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:54.067665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40847d65-9e5a-4c6e-8a44-9a1360ebba5c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:54.115772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313e5c5-05a4-4b2f-b851-9de1fe449b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:54.116763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e5c5-05a4-4b2f-b851-9de1fe449b53 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:54.117428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e5c5-05a4-4b2f-b851-9de1fe449b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:54.117841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e5c5-05a4-4b2f-b851-9de1fe449b53 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:54.119156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313e5c5-05a4-4b2f-b851-9de1fe449b53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:54.119827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313e5c5-05a4-4b2f-b851-9de1fe449b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:54.122161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313e5c5-05a4-4b2f-b851-9de1fe449b53 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:54.126260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 154/299] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:54.133248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 146/300] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:54.140584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755c53-4cdd-423e-92e8-e1145518d92d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:54.151376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313e5c5-05a4-4b2f-b851-9de1fe449b53 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:54.261144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755c53-4cdd-423e-92e8-e1145518d92d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:54.280581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313e5c5-05a4-4b2f-b851-9de1fe449b53 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:54.298695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45254d29-27a8-48d5-b1bf-2b350e273022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:54.299354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45254d29-27a8-48d5-b1bf-2b350e273022 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:54.299805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45254d29-27a8-48d5-b1bf-2b350e273022 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:54.300077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45254d29-27a8-48d5-b1bf-2b350e273022 None admin] PATH_INFO: `/v3/users/ced12335be2a40579bbc39c13b618ea7` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:54.317106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45254d29-27a8-48d5-b1bf-2b350e273022 None admin] RBAC: Authorizing `identity:get_user(user_id=ced12335be2a40579bbc39c13b618ea7)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:54.317541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:54.319714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45254d29-27a8-48d5-b1bf-2b350e273022 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:54.322184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 155/301] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:54 2022] GET /identity/v3/users/ced12335be2a40579bbc39c13b618ea7 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:54.328223 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45254d29-27a8-48d5-b1bf-2b350e273022 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:54.331528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:54.333542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f963e7-e21f-4f20-b17a-b39454abf26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:54.334492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f963e7-e21f-4f20-b17a-b39454abf26e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:54.334999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f963e7-e21f-4f20-b17a-b39454abf26e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:54.335469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f963e7-e21f-4f20-b17a-b39454abf26e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:54.336887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f963e7-e21f-4f20-b17a-b39454abf26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:54.338667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f963e7-e21f-4f20-b17a-b39454abf26e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:54.340839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 147/302] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:54.348374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f963e7-e21f-4f20-b17a-b39454abf26e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:54.444558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45254d29-27a8-48d5-b1bf-2b350e273022 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:54.476766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f963e7-e21f-4f20-b17a-b39454abf26e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:54.481766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa06f6-3932-4f8e-9e2f-89e7fb35a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:54.482808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa06f6-3932-4f8e-9e2f-89e7fb35a657 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:54.483286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa06f6-3932-4f8e-9e2f-89e7fb35a657 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:54.483757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa06f6-3932-4f8e-9e2f-89e7fb35a657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:54.484787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa06f6-3932-4f8e-9e2f-89e7fb35a657 None admin] RBAC: Adding query filter params (role.id=d2c3206fe0a4419283e432c1f5e555e6, user.id=ced12335be2a40579bbc39c13b618ea7, scope.system=all) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:54.485391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa06f6-3932-4f8e-9e2f-89e7fb35a657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:54.487144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa06f6-3932-4f8e-9e2f-89e7fb35a657 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:54.493618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 156/303] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 26 07:13:54 2022] GET /identity/v3/role_assignments?user.id=ced12335be2a40579bbc39c13b618ea7&scope.system=all&role.id=d2c3206fe0a4419283e432c1f5e555e6 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:54.517237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c41ef-5581-436c-aab3-50165151fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:54.518187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c41ef-5581-436c-aab3-50165151fae8 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:54.518615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c41ef-5581-436c-aab3-50165151fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:54.519063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c41ef-5581-436c-aab3-50165151fae8 None admin] PATH_INFO: `/v3/groups` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:54.520003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c41ef-5581-436c-aab3-50165151fae8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:54.521703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c41ef-5581-436c-aab3-50165151fae8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:54.540935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 148/304] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Jul 26 07:13:54 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:13:54.740521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f463b-3c4a-4e4a-bc3c-a53c9aa3dfbe None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:54.741195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f463b-3c4a-4e4a-bc3c-a53c9aa3dfbe None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:54.741858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f463b-3c4a-4e4a-bc3c-a53c9aa3dfbe None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:54.743805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 157/305] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:54.749784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacff6-ccdf-4df7-89b1-399c06e38064 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:54.750340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacff6-ccdf-4df7-89b1-399c06e38064 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:54.750838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacff6-ccdf-4df7-89b1-399c06e38064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:54.772989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f7eacff6-ccdf-4df7-89b1-399c06e38064 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:54.774575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f7eacff6-ccdf-4df7-89b1-399c06e38064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:54.832466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:54.847703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 149/306] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:54.870375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f463b-3c4a-4e4a-bc3c-a53c9aa3dfbe None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:54.950039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:54.993528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f463b-3c4a-4e4a-bc3c-a53c9aa3dfbe None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:55.029828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465bc59-3fb0-4567-b8bf-ee115f7e2c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:55.030488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465bc59-3fb0-4567-b8bf-ee115f7e2c76 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:55.030762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465bc59-3fb0-4567-b8bf-ee115f7e2c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:55.031032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465bc59-3fb0-4567-b8bf-ee115f7e2c76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:55.041946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465bc59-3fb0-4567-b8bf-ee115f7e2c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c465bc59-3fb0-4567-b8bf-ee115f7e2c76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:55.046985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:55.047968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:55.048811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 158/307] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:55.056121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eacff6-ccdf-4df7-89b1-399c06e38064 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:55.165566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eacff6-ccdf-4df7-89b1-399c06e38064 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:55.205523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a0646-ff46-4aba-b537-5a1e59690341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:55.206083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a0646-ff46-4aba-b537-5a1e59690341 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:55.206366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a0646-ff46-4aba-b537-5a1e59690341 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:55.206648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a0646-ff46-4aba-b537-5a1e59690341 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:55.207459 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a0646-ff46-4aba-b537-5a1e59690341 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:55.207768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a0646-ff46-4aba-b537-5a1e59690341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:55.209184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a0646-ff46-4aba-b537-5a1e59690341 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:55.219163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 150/308] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:55.224737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465bc59-3fb0-4567-b8bf-ee115f7e2c76 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:55.332657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465bc59-3fb0-4567-b8bf-ee115f7e2c76 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:55.364672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:55.374208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8b7bc-ac0f-45ad-a06a-1955dce8cadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:55.374867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8b7bc-ac0f-45ad-a06a-1955dce8cadd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:55.375141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8b7bc-ac0f-45ad-a06a-1955dce8cadd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:55.375409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8b7bc-ac0f-45ad-a06a-1955dce8cadd None admin] PATH_INFO: `/v3/users/6b77d40b68214592ab5a20edf0f51a2f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:55.376589 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8b7bc-ac0f-45ad-a06a-1955dce8cadd None admin] RBAC: Authorizing `identity:get_user(user_id=6b77d40b68214592ab5a20edf0f51a2f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:55.378066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8b7bc-ac0f-45ad-a06a-1955dce8cadd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:55.379898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 159/309] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:55 2022] GET /identity/v3/users/6b77d40b68214592ab5a20edf0f51a2f => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:55.385495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a0646-ff46-4aba-b537-5a1e59690341 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:55.433937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2a8d4-26b2-4f27-bb6e-b82719b1e797 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:55.434272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2a8d4-26b2-4f27-bb6e-b82719b1e797 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:55.434477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2a8d4-26b2-4f27-bb6e-b82719b1e797 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:55.435993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 160/310] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:55.441600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7695b-43fd-42a2-8967-7b0193fd7275 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:55.441882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7695b-43fd-42a2-8967-7b0193fd7275 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:55.442158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7695b-43fd-42a2-8967-7b0193fd7275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:55.444430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:55.464622 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-27d7695b-43fd-42a2-8967-7b0193fd7275 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:55.465929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-27d7695b-43fd-42a2-8967-7b0193fd7275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:55.503499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a0646-ff46-4aba-b537-5a1e59690341 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:55.544540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b7246-8e49-4f42-ba70-5f560a73e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:55.545649 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b7246-8e49-4f42-ba70-5f560a73e494 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:55.546145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b7246-8e49-4f42-ba70-5f560a73e494 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:55.546644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b7246-8e49-4f42-ba70-5f560a73e494 None admin] PATH_INFO: `/v3/system/users/6b77d40b68214592ab5a20edf0f51a2f/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:55.548377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b7246-8e49-4f42-ba70-5f560a73e494 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6b77d40b68214592ab5a20edf0f51a2f, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:55.550014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b7246-8e49-4f42-ba70-5f560a73e494 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:55.552146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 161/311] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:55.562799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 151/312] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Jul 26 07:13:55 2022] PUT /identity/v3/system/users/6b77d40b68214592ab5a20edf0f51a2f/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:13:55.573670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7695b-43fd-42a2-8967-7b0193fd7275 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:55.692293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7695b-43fd-42a2-8967-7b0193fd7275 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:55.721835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:55.734933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1470ae-9293-4fb2-8d32-b995e482c68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:55.735597 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1470ae-9293-4fb2-8d32-b995e482c68f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:55.735880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1470ae-9293-4fb2-8d32-b995e482c68f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:55.736148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1470ae-9293-4fb2-8d32-b995e482c68f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:55.747951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1470ae-9293-4fb2-8d32-b995e482c68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ed1470ae-9293-4fb2-8d32-b995e482c68f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:55.752981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:55.754040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:55.754844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 162/313] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:55.760649 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b7246-8e49-4f42-ba70-5f560a73e494 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:55.871917 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b7246-8e49-4f42-ba70-5f560a73e494 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:55.886466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:55.906945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c2b8a-2f15-48ef-966e-638c9970130e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:55.907586 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c2b8a-2f15-48ef-966e-638c9970130e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:55.907917 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c2b8a-2f15-48ef-966e-638c9970130e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:55.908355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c2b8a-2f15-48ef-966e-638c9970130e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:55.909093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c2b8a-2f15-48ef-966e-638c9970130e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:55.909429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c2b8a-2f15-48ef-966e-638c9970130e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:55.910926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c2b8a-2f15-48ef-966e-638c9970130e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:55.920664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 152/314] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:55.926434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1470ae-9293-4fb2-8d32-b995e482c68f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:56.034611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1470ae-9293-4fb2-8d32-b995e482c68f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:56.075213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c1f10-0d07-42ad-bc1e-8f4c787ab8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:56.076029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c1f10-0d07-42ad-bc1e-8f4c787ab8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:56.076309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c1f10-0d07-42ad-bc1e-8f4c787ab8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:56.076577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c1f10-0d07-42ad-bc1e-8f4c787ab8b4 None admin] PATH_INFO: `/v3/users/c6c329b38e3b4697b109e2cb5d88c683` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:56.077902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c1f10-0d07-42ad-bc1e-8f4c787ab8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c6c329b38e3b4697b109e2cb5d88c683)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:56.079575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c1f10-0d07-42ad-bc1e-8f4c787ab8b4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:56.081692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 163/315] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:55 2022] GET /identity/v3/users/c6c329b38e3b4697b109e2cb5d88c683 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:56.089350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c2b8a-2f15-48ef-966e-638c9970130e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:56.211875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c2b8a-2f15-48ef-966e-638c9970130e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:56.247967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e64a93-9893-4f73-802b-dadb7f139aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:56.248611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64a93-9893-4f73-802b-dadb7f139aaa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:56.248892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64a93-9893-4f73-802b-dadb7f139aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:56.249168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64a93-9893-4f73-802b-dadb7f139aaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:56.297373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:56.321082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e64a93-9893-4f73-802b-dadb7f139aaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:56.322606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e64a93-9893-4f73-802b-dadb7f139aaa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:56.435747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 153/316] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:13:56.444072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c1f10-0d07-42ad-bc1e-8f4c787ab8b4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:56.519281 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:56.576377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c1f10-0d07-42ad-bc1e-8f4c787ab8b4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:56.597629 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52edf9-df89-4285-91b4-11a99f977d9d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:56.597956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52edf9-df89-4285-91b4-11a99f977d9d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:56.598176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52edf9-df89-4285-91b4-11a99f977d9d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:56.599853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 154/317] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:13:56.605065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f9ac-34e5-4389-a02c-eed88bb101ce None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:56.605549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f9ac-34e5-4389-a02c-eed88bb101ce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:56.605836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f9ac-34e5-4389-a02c-eed88bb101ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:56.612394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f416f2e-d486-4a09-9194-d1d09bbea269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:56.613088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f416f2e-d486-4a09-9194-d1d09bbea269 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:56.613396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f416f2e-d486-4a09-9194-d1d09bbea269 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:56.613789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f416f2e-d486-4a09-9194-d1d09bbea269 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:56.615079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f416f2e-d486-4a09-9194-d1d09bbea269 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:56.616530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f416f2e-d486-4a09-9194-d1d09bbea269 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:56.618337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 164/318] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:13:56 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:56.624462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f416f2e-d486-4a09-9194-d1d09bbea269 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:56.626771 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4295f9ac-34e5-4389-a02c-eed88bb101ce None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:56.629489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4295f9ac-34e5-4389-a02c-eed88bb101ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:56.718991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 155/319] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:13:56.738937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f9ac-34e5-4389-a02c-eed88bb101ce None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:56.747521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:56.774661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f416f2e-d486-4a09-9194-d1d09bbea269 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:56.798716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:56.815683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77be2d-2e13-4902-94d7-41f76cab0c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:56.816461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77be2d-2e13-4902-94d7-41f76cab0c95 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:56.816790 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77be2d-2e13-4902-94d7-41f76cab0c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:56.817062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77be2d-2e13-4902-94d7-41f76cab0c95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:56.818057 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77be2d-2e13-4902-94d7-41f76cab0c95 None admin] RBAC: Adding query filter params (role.id=d2c3206fe0a4419283e432c1f5e555e6, scope.project.id=6fe9341b7bf94c7bb282049899463dec, user.id=c6c329b38e3b4697b109e2cb5d88c683) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:56.818371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77be2d-2e13-4902-94d7-41f76cab0c95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:56.819859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77be2d-2e13-4902-94d7-41f76cab0c95 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:56.835726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 165/320] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:13:56 2022] GET /identity/v3/role_assignments?user.id=c6c329b38e3b4697b109e2cb5d88c683&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=d2c3206fe0a4419283e432c1f5e555e6 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:56.835726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f42898-35f3-46c8-8c4c-4ad9ad827b78 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:56.835726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f42898-35f3-46c8-8c4c-4ad9ad827b78 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:56.835726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f42898-35f3-46c8-8c4c-4ad9ad827b78 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:56.835726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 166/321] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:56.837431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34bfe4-7fb3-40a0-b384-61de3fc23f62 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:56.837712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34bfe4-7fb3-40a0-b384-61de3fc23f62 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:56.837981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34bfe4-7fb3-40a0-b384-61de3fc23f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:56.859233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3d34bfe4-7fb3-40a0-b384-61de3fc23f62 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:56.860541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3d34bfe4-7fb3-40a0-b384-61de3fc23f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:56.867190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f9ac-34e5-4389-a02c-eed88bb101ce None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:56.909011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d4d62-051d-456f-9951-00463c2ff17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:56.910298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d4d62-051d-456f-9951-00463c2ff17d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:56.910840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d4d62-051d-456f-9951-00463c2ff17d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:56.911348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d4d62-051d-456f-9951-00463c2ff17d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:56.930901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d4d62-051d-456f-9951-00463c2ff17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b87d4d62-051d-456f-9951-00463c2ff17d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:56.939027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:56.940232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:13:56.941292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:13:56.944105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 156/322] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:13:56.952069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d4d62-051d-456f-9951-00463c2ff17d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:56.961285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 167/323] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:56.980119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34bfe4-7fb3-40a0-b384-61de3fc23f62 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:57.064038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:57.111171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d4d62-051d-456f-9951-00463c2ff17d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:57.128794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34bfe4-7fb3-40a0-b384-61de3fc23f62 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:57.144819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:57.157465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1e8dc-09d2-451d-ac2e-b1bebd4c2534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:57.158103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1e8dc-09d2-451d-ac2e-b1bebd4c2534 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:57.158385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1e8dc-09d2-451d-ac2e-b1bebd4c2534 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:57.158664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1e8dc-09d2-451d-ac2e-b1bebd4c2534 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:57.159395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1e8dc-09d2-451d-ac2e-b1bebd4c2534 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:57.159699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1e8dc-09d2-451d-ac2e-b1bebd4c2534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:57.161174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1e8dc-09d2-451d-ac2e-b1bebd4c2534 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:57.169618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 157/324] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:57.170999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9c515-f35a-4ef1-b0cc-9d96737174b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:57.171660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9c515-f35a-4ef1-b0cc-9d96737174b9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:57.171932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9c515-f35a-4ef1-b0cc-9d96737174b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:57.172199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9c515-f35a-4ef1-b0cc-9d96737174b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:57.173363 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9c515-f35a-4ef1-b0cc-9d96737174b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:57.174960 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9c515-f35a-4ef1-b0cc-9d96737174b9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:57.175385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1e8dc-09d2-451d-ac2e-b1bebd4c2534 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:57.181778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 168/325] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:13:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:57.182851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9c515-f35a-4ef1-b0cc-9d96737174b9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:57.299469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1e8dc-09d2-451d-ac2e-b1bebd4c2534 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:57.333672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9c515-f35a-4ef1-b0cc-9d96737174b9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:57.338991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:57.352003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc5d1-7e78-4eca-9ad7-f6fa4ee1408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:57.352871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc5d1-7e78-4eca-9ad7-f6fa4ee1408f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:57.353347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc5d1-7e78-4eca-9ad7-f6fa4ee1408f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:57.353794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc5d1-7e78-4eca-9ad7-f6fa4ee1408f None admin] PATH_INFO: `/v3/users/ced12335be2a40579bbc39c13b618ea7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:57.355556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc5d1-7e78-4eca-9ad7-f6fa4ee1408f None admin] RBAC: Authorizing `identity:get_user(user_id=ced12335be2a40579bbc39c13b618ea7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:57.358072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc5d1-7e78-4eca-9ad7-f6fa4ee1408f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:57.360935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 158/326] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:57 2022] GET /identity/v3/users/ced12335be2a40579bbc39c13b618ea7 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:13:57.369675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc5d1-7e78-4eca-9ad7-f6fa4ee1408f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:57.391436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bbddc-f21f-428e-ba71-41dfc7fa7a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:57.392472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bbddc-f21f-428e-ba71-41dfc7fa7a5f None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:57.393059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bbddc-f21f-428e-ba71-41dfc7fa7a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:57.393525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bbddc-f21f-428e-ba71-41dfc7fa7a5f None admin] PATH_INFO: `/v3/groups` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:57.394622 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bbddc-f21f-428e-ba71-41dfc7fa7a5f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:57.397253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bbddc-f21f-428e-ba71-41dfc7fa7a5f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:57.425604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 169/327] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Jul 26 07:13:57 2022] POST /identity/v3/groups => generated 226 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:13:57.536358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc5d1-7e78-4eca-9ad7-f6fa4ee1408f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:57.585134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af58b23-4341-4c42-8b18-7847e794693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:57.585860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58b23-4341-4c42-8b18-7847e794693d None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:57.586189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58b23-4341-4c42-8b18-7847e794693d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:57.586460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58b23-4341-4c42-8b18-7847e794693d None admin] PATH_INFO: `/v3/system/users/ced12335be2a40579bbc39c13b618ea7/roles/d2c3206fe0a4419283e432c1f5e555e6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:57.588060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af58b23-4341-4c42-8b18-7847e794693d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ced12335be2a40579bbc39c13b618ea7, role_id=d2c3206fe0a4419283e432c1f5e555e6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:57.589539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af58b23-4341-4c42-8b18-7847e794693d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:57.600061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 159/328] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Jul 26 07:13:57 2022] PUT /identity/v3/system/users/ced12335be2a40579bbc39c13b618ea7/roles/d2c3206fe0a4419283e432c1f5e555e6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:13:57.806830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225c5cd-266d-498e-b286-fdbbd204f2d3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:57.807205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225c5cd-266d-498e-b286-fdbbd204f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:57.807400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225c5cd-266d-498e-b286-fdbbd204f2d3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:57.809026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 170/329] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:57.814724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5871-e489-4d17-91c6-3cc72567da99 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:57.815017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5871-e489-4d17-91c6-3cc72567da99 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:57.815279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5871-e489-4d17-91c6-3cc72567da99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:57.837641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1b7c5871-e489-4d17-91c6-3cc72567da99 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:57.839181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1b7c5871-e489-4d17-91c6-3cc72567da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:13:57.904993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:57.919107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 160/330] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:13:57.944132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225c5cd-266d-498e-b286-fdbbd204f2d3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:57.998470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:58.072893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225c5cd-266d-498e-b286-fdbbd204f2d3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:58.119990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de874aa-1cee-45b3-8bc5-2d20c7e59c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:58.120657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de874aa-1cee-45b3-8bc5-2d20c7e59c93 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:58.120934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de874aa-1cee-45b3-8bc5-2d20c7e59c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:58.121208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de874aa-1cee-45b3-8bc5-2d20c7e59c93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:58.132943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de874aa-1cee-45b3-8bc5-2d20c7e59c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0de874aa-1cee-45b3-8bc5-2d20c7e59c93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:13:58.138521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:13:58.139415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:13:58.140224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:13:58.145672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 171/331] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:13:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:13:58.146976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5871-e489-4d17-91c6-3cc72567da99 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:58.260106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5871-e489-4d17-91c6-3cc72567da99 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:58.298369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be27284-d388-45a0-bd01-283800fc2202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:58.299004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be27284-d388-45a0-bd01-283800fc2202 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:58.299278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be27284-d388-45a0-bd01-283800fc2202 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:58.299553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be27284-d388-45a0-bd01-283800fc2202 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:58.300267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be27284-d388-45a0-bd01-283800fc2202 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:58.300626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be27284-d388-45a0-bd01-283800fc2202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:58.302116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be27284-d388-45a0-bd01-283800fc2202 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:58.313287 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 161/332] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:13:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:58.319105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de874aa-1cee-45b3-8bc5-2d20c7e59c93 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:58.446624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de874aa-1cee-45b3-8bc5-2d20c7e59c93 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:58.448196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:58.484894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a7a23-deb6-4a68-bcd2-36ed68efca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:58.485588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a7a23-deb6-4a68-bcd2-36ed68efca15 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:58.485861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a7a23-deb6-4a68-bcd2-36ed68efca15 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:58.486131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a7a23-deb6-4a68-bcd2-36ed68efca15 None admin] PATH_INFO: `/v3/users/6b77d40b68214592ab5a20edf0f51a2f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:58.487368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a7a23-deb6-4a68-bcd2-36ed68efca15 None admin] RBAC: Authorizing `identity:get_user(user_id=6b77d40b68214592ab5a20edf0f51a2f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:58.488970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a7a23-deb6-4a68-bcd2-36ed68efca15 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:58.490972 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 172/333] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:13:58 2022] GET /identity/v3/users/6b77d40b68214592ab5a20edf0f51a2f => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:58.496860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be27284-d388-45a0-bd01-283800fc2202 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:13:58.569536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:13:58.638297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be27284-d388-45a0-bd01-283800fc2202 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:13:58.684630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae475a-6ca6-4e9b-a88c-fe68cfdd4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:13:58.685294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae475a-6ca6-4e9b-a88c-fe68cfdd4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:58.685574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae475a-6ca6-4e9b-a88c-fe68cfdd4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:58.685841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae475a-6ca6-4e9b-a88c-fe68cfdd4fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:58.686644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae475a-6ca6-4e9b-a88c-fe68cfdd4fa2 None admin] RBAC: Adding query filter params (role.id=c0c80af8168f45fc9fffd24abe0136f3, user.id=6b77d40b68214592ab5a20edf0f51a2f, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:13:58.686947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae475a-6ca6-4e9b-a88c-fe68cfdd4fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:13:58.688380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae475a-6ca6-4e9b-a88c-fe68cfdd4fa2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:13:58.705683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 162/334] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 26 07:13:58 2022] GET /identity/v3/role_assignments?user.id=6b77d40b68214592ab5a20edf0f51a2f&scope.system=all&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:13:59.894605 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f2e6-1319-4ed8-b161-6d4e576f9f00 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:59.895584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f2e6-1319-4ed8-b161-6d4e576f9f00 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:59.896083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f2e6-1319-4ed8-b161-6d4e576f9f00 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:59.897716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 173/335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:13:59.903214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf066d8-8dd6-4cd8-b583-1a34a029d689 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:13:59.903669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf066d8-8dd6-4cd8-b583-1a34a029d689 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:13:59.903742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf066d8-8dd6-4cd8-b583-1a34a029d689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:13:59.930326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9bf066d8-8dd6-4cd8-b583-1a34a029d689 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:13:59.931562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9bf066d8-8dd6-4cd8-b583-1a34a029d689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:00.020150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 163/336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:00.064018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f2e6-1319-4ed8-b161-6d4e576f9f00 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:00.200231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75491f3-3bf8-4643-a317-4e0d6a56957c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:00.200939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75491f3-3bf8-4643-a317-4e0d6a56957c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:00.201470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75491f3-3bf8-4643-a317-4e0d6a56957c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:00.204279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 164/337] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:00.214487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c67955-b361-4274-a555-8ec961e76c34 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:00.215055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c67955-b361-4274-a555-8ec961e76c34 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:00.215538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c67955-b361-4274-a555-8ec961e76c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:00.222612 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f2e6-1319-4ed8-b161-6d4e576f9f00 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:00.254501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d6c67955-b361-4274-a555-8ec961e76c34 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:00.256051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d6c67955-b361-4274-a555-8ec961e76c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:00.265172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a753ba-6a9d-40d6-a195-2308d1afa2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:00.265858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a753ba-6a9d-40d6-a195-2308d1afa2fe None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:00.269315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a753ba-6a9d-40d6-a195-2308d1afa2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:00.269315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a753ba-6a9d-40d6-a195-2308d1afa2fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:00.278941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a753ba-6a9d-40d6-a195-2308d1afa2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f1a753ba-6a9d-40d6-a195-2308d1afa2fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:00.283903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:00.284798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:00.285809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 174/338] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:00.287001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2289-866b-4338-8baa-59740585c6d5 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:00.287001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2289-866b-4338-8baa-59740585c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:00.287226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2289-866b-4338-8baa-59740585c6d5 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:00.288781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 175/339] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:00.293398 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f2289-866b-4338-8baa-59740585c6d5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:00.323603 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:00.325802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:00.368199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 165/340] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:00.369966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f740bab-2661-402c-8659-c11f4acaf563 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:00.370443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f740bab-2661-402c-8659-c11f4acaf563 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:00.370933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f740bab-2661-402c-8659-c11f4acaf563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:00.393373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3f740bab-2661-402c-8659-c11f4acaf563 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:00.395005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3f740bab-2661-402c-8659-c11f4acaf563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:00.458099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f2289-866b-4338-8baa-59740585c6d5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:00.496590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 166/341] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:00.498180 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f740bab-2661-402c-8659-c11f4acaf563 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:00.562012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd174b-db22-4661-b3c2-5afa00c0295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:00.562824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd174b-db22-4661-b3c2-5afa00c0295d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:00.563076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd174b-db22-4661-b3c2-5afa00c0295d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:00.563355 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd174b-db22-4661-b3c2-5afa00c0295d None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:00.564102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd174b-db22-4661-b3c2-5afa00c0295d None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:00.564412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd174b-db22-4661-b3c2-5afa00c0295d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:00.565877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd174b-db22-4661-b3c2-5afa00c0295d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:00.588009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 176/342] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:14:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:00.589019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd174b-db22-4661-b3c2-5afa00c0295d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:00.616441 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:00.621105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f740bab-2661-402c-8659-c11f4acaf563 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:00.691891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568f837-85ed-4874-9ccf-6b1e7cc3d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:00.692577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568f837-85ed-4874-9ccf-6b1e7cc3d96e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:00.692907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568f837-85ed-4874-9ccf-6b1e7cc3d96e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:00.693186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568f837-85ed-4874-9ccf-6b1e7cc3d96e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:00.717318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568f837-85ed-4874-9ccf-6b1e7cc3d96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6568f837-85ed-4874-9ccf-6b1e7cc3d96e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:00.728476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:00.729492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:00.730308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:00.733029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 167/343] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:00.734084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568f837-85ed-4874-9ccf-6b1e7cc3d96e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:00.758174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:00.766505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd174b-db22-4661-b3c2-5afa00c0295d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:00.805948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e57d42-41ec-4b92-ada5-9086846d620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:00.807064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57d42-41ec-4b92-ada5-9086846d620c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:00.807544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57d42-41ec-4b92-ada5-9086846d620c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:00.808025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57d42-41ec-4b92-ada5-9086846d620c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:00.824091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e57d42-41ec-4b92-ada5-9086846d620c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a3e57d42-41ec-4b92-ada5-9086846d620c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:00.830698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:00.831669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:14:00.832555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:00.837105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 177/344] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:00.838437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e57d42-41ec-4b92-ada5-9086846d620c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:00.975785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e57d42-41ec-4b92-ada5-9086846d620c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:00.988780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568f837-85ed-4874-9ccf-6b1e7cc3d96e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:01.021373 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee57c0-332f-461c-977c-f46e4bb60540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:01.022021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee57c0-332f-461c-977c-f46e4bb60540 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.022300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee57c0-332f-461c-977c-f46e4bb60540 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.022568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee57c0-332f-461c-977c-f46e4bb60540 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.023301 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee57c0-332f-461c-977c-f46e4bb60540 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:01.023702 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee57c0-332f-461c-977c-f46e4bb60540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:01.025221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee57c0-332f-461c-977c-f46e4bb60540 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:01.039652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72326054-e106-4258-894a-0194479af73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:01.040306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72326054-e106-4258-894a-0194479af73b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.040585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72326054-e106-4258-894a-0194479af73b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.040860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72326054-e106-4258-894a-0194479af73b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.043932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 178/345] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:01.044958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee57c0-332f-461c-977c-f46e4bb60540 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:01.073433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:01.101062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:01.165445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72326054-e106-4258-894a-0194479af73b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:01.168357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72326054-e106-4258-894a-0194479af73b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:01.208421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee57c0-332f-461c-977c-f46e4bb60540 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:01.257115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199282d-abfe-4186-90c7-e09d498a9075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:01.258127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199282d-abfe-4186-90c7-e09d498a9075 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.258615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199282d-abfe-4186-90c7-e09d498a9075 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.259086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199282d-abfe-4186-90c7-e09d498a9075 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.260038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199282d-abfe-4186-90c7-e09d498a9075 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:01.260542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199282d-abfe-4186-90c7-e09d498a9075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:01.262187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199282d-abfe-4186-90c7-e09d498a9075 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:01.271963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 179/346] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:14:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:01.274137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199282d-abfe-4186-90c7-e09d498a9075 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:01.305697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 168/347] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:01.307053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74591b5-d49e-4fc3-a289-8cdff519cd13 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.307269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74591b5-d49e-4fc3-a289-8cdff519cd13 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.307540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74591b5-d49e-4fc3-a289-8cdff519cd13 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.312922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 169/348] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:01.312922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74591b5-d49e-4fc3-a289-8cdff519cd13 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:01.364124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:01.374607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:01.392231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199282d-abfe-4186-90c7-e09d498a9075 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:01.418777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74591b5-d49e-4fc3-a289-8cdff519cd13 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:01.430603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd877596-f5d2-4e66-ac5f-c1df678b23db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:01.430603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877596-f5d2-4e66-ac5f-c1df678b23db None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.430603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877596-f5d2-4e66-ac5f-c1df678b23db None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.431072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877596-f5d2-4e66-ac5f-c1df678b23db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.459266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcd447-1703-4b4c-9828-73699620c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:01.460244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcd447-1703-4b4c-9828-73699620c19c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.460691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcd447-1703-4b4c-9828-73699620c19c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.461152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcd447-1703-4b4c-9828-73699620c19c None admin] PATH_INFO: `/v3/users/ced12335be2a40579bbc39c13b618ea7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.462720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcd447-1703-4b4c-9828-73699620c19c None admin] RBAC: Authorizing `identity:get_user(user_id=ced12335be2a40579bbc39c13b618ea7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:01.464355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcd447-1703-4b4c-9828-73699620c19c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:01.466691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 170/349] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:14:01 2022] GET /identity/v3/users/ced12335be2a40579bbc39c13b618ea7 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:01.467713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcd447-1703-4b4c-9828-73699620c19c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:01.510926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd877596-f5d2-4e66-ac5f-c1df678b23db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:01.512558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd877596-f5d2-4e66-ac5f-c1df678b23db None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:01.596016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:01.621478 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcd447-1703-4b4c-9828-73699620c19c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:01.629994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 180/350] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:01.631160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47fe4a-feff-4f43-a3fa-0986166dbc7b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.631269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47fe4a-feff-4f43-a3fa-0986166dbc7b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.631626 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47fe4a-feff-4f43-a3fa-0986166dbc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.656908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bf47fe4a-feff-4f43-a3fa-0986166dbc7b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:01.658827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bf47fe4a-feff-4f43-a3fa-0986166dbc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:01.665653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:01.668813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174fb84-000f-43bf-8018-14a287dc13ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:01.669673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174fb84-000f-43bf-8018-14a287dc13ba None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.670046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174fb84-000f-43bf-8018-14a287dc13ba None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.670425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174fb84-000f-43bf-8018-14a287dc13ba None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.671798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174fb84-000f-43bf-8018-14a287dc13ba None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:01.674398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174fb84-000f-43bf-8018-14a287dc13ba None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:01.676996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 171/351] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:01 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:01.677959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174fb84-000f-43bf-8018-14a287dc13ba None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:01.744700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 181/352] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:01.750396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47fe4a-feff-4f43-a3fa-0986166dbc7b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:01.804414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174fb84-000f-43bf-8018-14a287dc13ba None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:01.845064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb617f-4af0-44dd-bfdb-0e5cc0d98857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:01.846143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb617f-4af0-44dd-bfdb-0e5cc0d98857 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.846606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb617f-4af0-44dd-bfdb-0e5cc0d98857 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.847051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb617f-4af0-44dd-bfdb-0e5cc0d98857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.848644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb617f-4af0-44dd-bfdb-0e5cc0d98857 None admin] RBAC: Adding query filter params (role.id=d2c3206fe0a4419283e432c1f5e555e6, user.id=ced12335be2a40579bbc39c13b618ea7, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:01.849189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb617f-4af0-44dd-bfdb-0e5cc0d98857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:01.851312 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb617f-4af0-44dd-bfdb-0e5cc0d98857 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:01.867000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 172/353] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 26 07:14:01 2022] GET /identity/v3/role_assignments?user.id=ced12335be2a40579bbc39c13b618ea7&scope.system=all&role.id=d2c3206fe0a4419283e432c1f5e555e6 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:01.868395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb617f-4af0-44dd-bfdb-0e5cc0d98857 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:01.879346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47fe4a-feff-4f43-a3fa-0986166dbc7b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:01.889389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:01.923378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd51cf-9c3b-43f5-808d-5d9b972898fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:01.924072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd51cf-9c3b-43f5-808d-5d9b972898fa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:01.924431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd51cf-9c3b-43f5-808d-5d9b972898fa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:01.924657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd51cf-9c3b-43f5-808d-5d9b972898fa None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:01.926003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd51cf-9c3b-43f5-808d-5d9b972898fa None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:01.927518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd51cf-9c3b-43f5-808d-5d9b972898fa None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:01.933992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 182/354] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:01 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:01.936261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd51cf-9c3b-43f5-808d-5d9b972898fa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:01.951715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:02.031080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb617f-4af0-44dd-bfdb-0e5cc0d98857 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:02.076325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb323a-c6fc-4b0e-baf6-d03e702415e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:02.076913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb323a-c6fc-4b0e-baf6-d03e702415e5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.077189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb323a-c6fc-4b0e-baf6-d03e702415e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.077703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb323a-c6fc-4b0e-baf6-d03e702415e5 None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.087162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd51cf-9c3b-43f5-808d-5d9b972898fa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:02.088394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb323a-c6fc-4b0e-baf6-d03e702415e5 None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:02.090371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb323a-c6fc-4b0e-baf6-d03e702415e5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:02.095975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 173/355] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:01 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:02.095975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0363d-d482-4277-9584-ada8545f5301 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.095975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0363d-d482-4277-9584-ada8545f5301 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.095975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0363d-d482-4277-9584-ada8545f5301 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.097318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 174/356] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:02.098091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0363d-d482-4277-9584-ada8545f5301 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:02.151077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e4f21-5398-467a-93b4-1cf723b20af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:02.151832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e4f21-5398-467a-93b4-1cf723b20af5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.152120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e4f21-5398-467a-93b4-1cf723b20af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.152394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e4f21-5398-467a-93b4-1cf723b20af5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.165001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e4f21-5398-467a-93b4-1cf723b20af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-585e4f21-5398-467a-93b4-1cf723b20af5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:02.170696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:02.171637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:02.172975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 183/357] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:02.174023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389da8d-5408-4238-8664-33c5827253f5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.174396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389da8d-5408-4238-8664-33c5827253f5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.174490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389da8d-5408-4238-8664-33c5827253f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.194333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0389da8d-5408-4238-8664-33c5827253f5 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:02.195560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0389da8d-5408-4238-8664-33c5827253f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:02.228139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:02.240889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0363d-d482-4277-9584-ada8545f5301 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:02.261116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:02.279670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 184/358] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:02.280511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389da8d-5408-4238-8664-33c5827253f5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:02.283550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a5afd-d300-4a18-a3d5-2da1598b0bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:02.285351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a5afd-d300-4a18-a3d5-2da1598b0bcd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.285830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a5afd-d300-4a18-a3d5-2da1598b0bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.286289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a5afd-d300-4a18-a3d5-2da1598b0bcd None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.287521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a5afd-d300-4a18-a3d5-2da1598b0bcd None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:02.288964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a5afd-d300-4a18-a3d5-2da1598b0bcd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:02.291191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 175/359] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:02 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:02.291986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a5afd-d300-4a18-a3d5-2da1598b0bcd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:02.410436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389da8d-5408-4238-8664-33c5827253f5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:02.415169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a5afd-d300-4a18-a3d5-2da1598b0bcd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:02.449795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23e744-0514-4f2e-9823-4970973d836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:02.450436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23e744-0514-4f2e-9823-4970973d836c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.450712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23e744-0514-4f2e-9823-4970973d836c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.451519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23e744-0514-4f2e-9823-4970973d836c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.451787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23e744-0514-4f2e-9823-4970973d836c None admin] RBAC: Adding query filter params (group.id=5f306e444f734481bf382a7c638fc233, role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=8096b1508e644200a9a730939b83c252) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:02.452100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23e744-0514-4f2e-9823-4970973d836c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:02.453577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d643e0-fd7b-4b4f-8176-5520b80192c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:02.453701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23e744-0514-4f2e-9823-4970973d836c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:02.454218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d643e0-fd7b-4b4f-8176-5520b80192c0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.454494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d643e0-fd7b-4b4f-8176-5520b80192c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.454765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d643e0-fd7b-4b4f-8176-5520b80192c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.455499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d643e0-fd7b-4b4f-8176-5520b80192c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:02.455800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d643e0-fd7b-4b4f-8176-5520b80192c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:02.457217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d643e0-fd7b-4b4f-8176-5520b80192c0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:02.461466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 185/360] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:02 2022] GET /identity/v3/role_assignments?group.id=5f306e444f734481bf382a7c638fc233&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:02.466786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27259d8a-0e4b-433a-8c0b-acbe58424e94 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.467073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27259d8a-0e4b-433a-8c0b-acbe58424e94 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.467348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27259d8a-0e4b-433a-8c0b-acbe58424e94 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.469324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 186/361] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:02.469672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 176/362] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:02.470472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d643e0-fd7b-4b4f-8176-5520b80192c0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:02.473575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27259d8a-0e4b-433a-8c0b-acbe58424e94 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:02.512432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:02.543748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:02.620096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d643e0-fd7b-4b4f-8176-5520b80192c0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:02.628491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27259d8a-0e4b-433a-8c0b-acbe58424e94 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:02.659806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd460a3d-2b90-494a-b74c-8b3e3a0df1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:02.660604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd460a3d-2b90-494a-b74c-8b3e3a0df1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.660823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd460a3d-2b90-494a-b74c-8b3e3a0df1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.661094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd460a3d-2b90-494a-b74c-8b3e3a0df1e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.674046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd460a3d-2b90-494a-b74c-8b3e3a0df1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:02.679121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836c443-67d9-4b41-906a-4a41facf10df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:02.679770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836c443-67d9-4b41-906a-4a41facf10df None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-dd460a3d-2b90-494a-b74c-8b3e3a0df1e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:02.679898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:02.680724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:02.681652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:02.682312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836c443-67d9-4b41-906a-4a41facf10df None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.682312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836c443-67d9-4b41-906a-4a41facf10df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.682452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 177/363] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:02.682519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836c443-67d9-4b41-906a-4a41facf10df None admin] RBAC: Adding query filter params (group.id=5f306e444f734481bf382a7c638fc233, role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=8096b1508e644200a9a730939b83c252) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:02.682519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836c443-67d9-4b41-906a-4a41facf10df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:02.682973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836c443-67d9-4b41-906a-4a41facf10df None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:02.685117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f1026-f0e9-4190-8439-db667f515488 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.685117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f1026-f0e9-4190-8439-db667f515488 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.685117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f1026-f0e9-4190-8439-db667f515488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.695837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 187/364] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:02 2022] GET /identity/v3/role_assignments?group.id=5f306e444f734481bf382a7c638fc233&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:02.697022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836c443-67d9-4b41-906a-4a41facf10df None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:02.712424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bb8f1026-f0e9-4190-8439-db667f515488 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:02.713720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bb8f1026-f0e9-4190-8439-db667f515488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:02.806991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 178/365] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:02.807661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f1026-f0e9-4190-8439-db667f515488 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:02.822959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:02.833634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836c443-67d9-4b41-906a-4a41facf10df None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:02.852722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:02.873690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d643d-fe76-4748-992c-5fa15a7339a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:02.874729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d643d-fe76-4748-992c-5fa15a7339a2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.875303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d643d-fe76-4748-992c-5fa15a7339a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.875587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d643d-fe76-4748-992c-5fa15a7339a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.926545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f1026-f0e9-4190-8439-db667f515488 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:02.965099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d643d-fe76-4748-992c-5fa15a7339a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:02.965730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e6436-53fc-48d1-b8b4-eca5eb921761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:02.966553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6436-53fc-48d1-b8b4-eca5eb921761 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:02.966658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d643d-fe76-4748-992c-5fa15a7339a2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:02.966831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6436-53fc-48d1-b8b4-eca5eb921761 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:02.967106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6436-53fc-48d1-b8b4-eca5eb921761 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:02.967851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e6436-53fc-48d1-b8b4-eca5eb921761 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:02.968166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e6436-53fc-48d1-b8b4-eca5eb921761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:02.970205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e6436-53fc-48d1-b8b4-eca5eb921761 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:02.981509 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 179/366] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:02.982397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e6436-53fc-48d1-b8b4-eca5eb921761 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:03.096141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:03.106896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:03.110419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e6436-53fc-48d1-b8b4-eca5eb921761 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:03.111687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 188/367] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:03.112554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d643d-fe76-4748-992c-5fa15a7339a2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:03.150657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097e33c-5332-46c4-94c6-deedc6c09aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:03.151375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097e33c-5332-46c4-94c6-deedc6c09aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:03.151650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097e33c-5332-46c4-94c6-deedc6c09aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:03.151928 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097e33c-5332-46c4-94c6-deedc6c09aa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:03.164707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097e33c-5332-46c4-94c6-deedc6c09aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5097e33c-5332-46c4-94c6-deedc6c09aa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:03.171986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:03.172902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 180/368] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:03.174638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097e33c-5332-46c4-94c6-deedc6c09aa1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:03.238416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d643d-fe76-4748-992c-5fa15a7339a2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:03.285848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665663a-0ba0-4bb5-a58d-5513447c3c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:03.286494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665663a-0ba0-4bb5-a58d-5513447c3c67 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:03.286939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665663a-0ba0-4bb5-a58d-5513447c3c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:03.287205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665663a-0ba0-4bb5-a58d-5513447c3c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:03.297309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097e33c-5332-46c4-94c6-deedc6c09aa1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:03.335797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ecbc7-dde6-403b-9c53-49aaa7813765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:03.337033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ecbc7-dde6-403b-9c53-49aaa7813765 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:03.337434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ecbc7-dde6-403b-9c53-49aaa7813765 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:03.337680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ecbc7-dde6-403b-9c53-49aaa7813765 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:03.338908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ecbc7-dde6-403b-9c53-49aaa7813765 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:03.340415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ecbc7-dde6-403b-9c53-49aaa7813765 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:03.344332 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 181/369] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:03 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:03.345128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ecbc7-dde6-403b-9c53-49aaa7813765 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:03.362632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:03.374529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665663a-0ba0-4bb5-a58d-5513447c3c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:03.376324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665663a-0ba0-4bb5-a58d-5513447c3c67 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:03.380004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:03.470862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ecbc7-dde6-403b-9c53-49aaa7813765 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:03.504832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 189/370] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:03.510020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665663a-0ba0-4bb5-a58d-5513447c3c67 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:03.515371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d65887-8bcf-49cf-87f3-8b730806d6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:03.516011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d65887-8bcf-49cf-87f3-8b730806d6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:03.516291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d65887-8bcf-49cf-87f3-8b730806d6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:03.516564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d65887-8bcf-49cf-87f3-8b730806d6b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:03.517328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d65887-8bcf-49cf-87f3-8b730806d6b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:03.517637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d65887-8bcf-49cf-87f3-8b730806d6b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:03.519010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d65887-8bcf-49cf-87f3-8b730806d6b0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:03.531591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 182/371] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:03.532446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d65887-8bcf-49cf-87f3-8b730806d6b0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:03.627129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:03.639404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665663a-0ba0-4bb5-a58d-5513447c3c67 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:03.648425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:03.660617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d65887-8bcf-49cf-87f3-8b730806d6b0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:03.686804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b07b92-1288-49ab-9e3f-8b6039c3c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:03.688003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07b92-1288-49ab-9e3f-8b6039c3c57c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:03.688554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07b92-1288-49ab-9e3f-8b6039c3c57c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:03.688846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07b92-1288-49ab-9e3f-8b6039c3c57c None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:03.690410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b07b92-1288-49ab-9e3f-8b6039c3c57c None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:03.692805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b07b92-1288-49ab-9e3f-8b6039c3c57c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:03.694840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 190/372] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:03 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:03.695666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b07b92-1288-49ab-9e3f-8b6039c3c57c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:03.723033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f2b7f-957b-4065-9b02-e1e848bbf913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:03.724092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2b7f-957b-4065-9b02-e1e848bbf913 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:03.724523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2b7f-957b-4065-9b02-e1e848bbf913 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:03.724977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2b7f-957b-4065-9b02-e1e848bbf913 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:03.731327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f2b7f-957b-4065-9b02-e1e848bbf913 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:03.735543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f2b7f-957b-4065-9b02-e1e848bbf913 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:03.739433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 183/373] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:03 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:03.744128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f2b7f-957b-4065-9b02-e1e848bbf913 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:03.814807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b07b92-1288-49ab-9e3f-8b6039c3c57c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:03.857923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91b3b-04cb-4a0c-acc5-427b328d0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:03.859026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91b3b-04cb-4a0c-acc5-427b328d0f7c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:03.859312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91b3b-04cb-4a0c-acc5-427b328d0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:03.859588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91b3b-04cb-4a0c-acc5-427b328d0f7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:03.894385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:03.942077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f2b7f-957b-4065-9b02-e1e848bbf913 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:03.944539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91b3b-04cb-4a0c-acc5-427b328d0f7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:03.946391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91b3b-04cb-4a0c-acc5-427b328d0f7c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:04.005570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6516d-7016-4441-988b-469a067b1f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:04.006628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6516d-7016-4441-988b-469a067b1f1b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:04.007123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6516d-7016-4441-988b-469a067b1f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:04.007584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6516d-7016-4441-988b-469a067b1f1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:04.009038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6516d-7016-4441-988b-469a067b1f1b None admin] RBAC: Adding query filter params (group.id=5f306e444f734481bf382a7c638fc233, role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=6fe9341b7bf94c7bb282049899463dec) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:04.011106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6516d-7016-4441-988b-469a067b1f1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:04.013825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6516d-7016-4441-988b-469a067b1f1b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:04.029423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 184/374] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:03 2022] GET /identity/v3/role_assignments?group.id=5f306e444f734481bf382a7c638fc233&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 260 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:04.030998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6516d-7016-4441-988b-469a067b1f1b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:04.063536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 191/375] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:04.077693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91b3b-04cb-4a0c-acc5-427b328d0f7c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:04.097950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:04.201092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:04.255086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6516d-7016-4441-988b-469a067b1f1b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:04.282362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91b3b-04cb-4a0c-acc5-427b328d0f7c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:04.312141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31586bb8-2880-4016-8947-f78d42287f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:04.312141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31586bb8-2880-4016-8947-f78d42287f23 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:04.312141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31586bb8-2880-4016-8947-f78d42287f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:04.312511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31586bb8-2880-4016-8947-f78d42287f23 None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:04.313535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31586bb8-2880-4016-8947-f78d42287f23 None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:04.315372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31586bb8-2880-4016-8947-f78d42287f23 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:04.317292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 185/376] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:04 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:04.327844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31586bb8-2880-4016-8947-f78d42287f23 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:04.352914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29938af-ed6b-413c-aef4-ec2da729b917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:04.354105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29938af-ed6b-413c-aef4-ec2da729b917 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:04.354532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29938af-ed6b-413c-aef4-ec2da729b917 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:04.355200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29938af-ed6b-413c-aef4-ec2da729b917 None admin] PATH_INFO: `/v3/projects/307d27a777014952aa29c6bcc39dc4ed` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:04.358139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29938af-ed6b-413c-aef4-ec2da729b917 None admin] RBAC: Authorizing `identity:get_project(project_id=307d27a777014952aa29c6bcc39dc4ed)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:04.360419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29938af-ed6b-413c-aef4-ec2da729b917 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:04.363363 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 192/377] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:04 2022] GET /identity/v3/projects/307d27a777014952aa29c6bcc39dc4ed => generated 344 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:04.368855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29938af-ed6b-413c-aef4-ec2da729b917 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:04.480399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:04.491566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31586bb8-2880-4016-8947-f78d42287f23 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:04.535971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b34ab-c828-47f6-8dfe-f2655b0c1f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:04.536630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b34ab-c828-47f6-8dfe-f2655b0c1f6a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:04.537302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b34ab-c828-47f6-8dfe-f2655b0c1f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:04.537580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b34ab-c828-47f6-8dfe-f2655b0c1f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:04.538394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b34ab-c828-47f6-8dfe-f2655b0c1f6a None admin] RBAC: Adding query filter params (group.id=5f306e444f734481bf382a7c638fc233, role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=6fe9341b7bf94c7bb282049899463dec) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:04.538703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b34ab-c828-47f6-8dfe-f2655b0c1f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:04.540151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b34ab-c828-47f6-8dfe-f2655b0c1f6a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:04.548950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 186/378] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:04 2022] GET /identity/v3/role_assignments?group.id=5f306e444f734481bf382a7c638fc233&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:04.559717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29938af-ed6b-413c-aef4-ec2da729b917 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:04.604971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:04.613735 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238aad23-bc8f-4734-aa75-c55285c4edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:04.618232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aad23-bc8f-4734-aa75-c55285c4edba None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:04.618553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aad23-bc8f-4734-aa75-c55285c4edba None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:04.618799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aad23-bc8f-4734-aa75-c55285c4edba None admin] PATH_INFO: `/v3/groups/ae715e3cea3d45719f78ee5146bc9600` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:04.626425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238aad23-bc8f-4734-aa75-c55285c4edba None admin] RBAC: Authorizing `identity:get_group(group_id=ae715e3cea3d45719f78ee5146bc9600)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:04.628042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238aad23-bc8f-4734-aa75-c55285c4edba None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:04.630396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 193/379] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:04 2022] GET /identity/v3/groups/ae715e3cea3d45719f78ee5146bc9600 => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:04.640094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b34ab-c828-47f6-8dfe-f2655b0c1f6a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:04.785787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b34ab-c828-47f6-8dfe-f2655b0c1f6a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:04.828644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ca265-980d-4b1c-941a-f0df421cfef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:04.829291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca265-980d-4b1c-941a-f0df421cfef4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:04.829573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca265-980d-4b1c-941a-f0df421cfef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:04.829843 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca265-980d-4b1c-941a-f0df421cfef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:04.830650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ca265-980d-4b1c-941a-f0df421cfef4 None admin] RBAC: Adding query filter params (group.id=ae715e3cea3d45719f78ee5146bc9600, role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=307d27a777014952aa29c6bcc39dc4ed) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:04.830950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ca265-980d-4b1c-941a-f0df421cfef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:04.832462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ca265-980d-4b1c-941a-f0df421cfef4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:04.837297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28522bce-d01f-4632-a3e3-f5afca794ad7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:04.839591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28522bce-d01f-4632-a3e3-f5afca794ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:04.839591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28522bce-d01f-4632-a3e3-f5afca794ad7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:04.840128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 194/380] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:04.845031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 187/381] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:04 2022] GET /identity/v3/role_assignments?group.id=ae715e3cea3d45719f78ee5146bc9600&scope.project.id=307d27a777014952aa29c6bcc39dc4ed&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:04.848369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad14e9-a356-4e9c-986e-10b233ad1f18 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:04.848993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad14e9-a356-4e9c-986e-10b233ad1f18 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:04.849503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad14e9-a356-4e9c-986e-10b233ad1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:04.886800 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-15ad14e9-a356-4e9c-986e-10b233ad1f18 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:04.888613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-15ad14e9-a356-4e9c-986e-10b233ad1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:04.992190 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 195/382] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:05.024921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ca265-980d-4b1c-941a-f0df421cfef4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:05.058376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:05.170968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ca265-980d-4b1c-941a-f0df421cfef4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:05.215476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47be07-8b14-4339-99d4-aece48fb854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:05.216166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47be07-8b14-4339-99d4-aece48fb854c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:05.216450 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47be07-8b14-4339-99d4-aece48fb854c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:05.216722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47be07-8b14-4339-99d4-aece48fb854c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47be07-8b14-4339-99d4-aece48fb854c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-df47be07-8b14-4339-99d4-aece48fb854c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:05.237044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:05.238097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:05.238971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 188/383] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:05.243280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad14e9-a356-4e9c-986e-10b233ad1f18 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:05.361883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad14e9-a356-4e9c-986e-10b233ad1f18 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:05.397304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:05.413440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1fc22-671b-4907-828b-cfc72c676953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:05.414470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1fc22-671b-4907-828b-cfc72c676953 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:05.414947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1fc22-671b-4907-828b-cfc72c676953 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:05.415413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1fc22-671b-4907-828b-cfc72c676953 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:05.416357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1fc22-671b-4907-828b-cfc72c676953 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:05.416871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1fc22-671b-4907-828b-cfc72c676953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:05.418503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1fc22-671b-4907-828b-cfc72c676953 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:05.428429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 196/384] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:14:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:05.434235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47be07-8b14-4339-99d4-aece48fb854c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:05.448434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ff9c1-3f00-4f1c-a066-7e2fcc39ab5b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:05.449053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ff9c1-3f00-4f1c-a066-7e2fcc39ab5b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:05.449357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ff9c1-3f00-4f1c-a066-7e2fcc39ab5b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:05.451344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 197/385] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:05.457351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd02e-4481-4e46-a69e-44ce9e0da0bf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:05.457640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd02e-4481-4e46-a69e-44ce9e0da0bf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:05.457914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd02e-4481-4e46-a69e-44ce9e0da0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:05.492268 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c4ecd02e-4481-4e46-a69e-44ce9e0da0bf None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:05.494084 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4ecd02e-4481-4e46-a69e-44ce9e0da0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:05.569058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:05.571734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 198/386] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:05.595521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecd02e-4481-4e46-a69e-44ce9e0da0bf None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:05.603481 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47be07-8b14-4339-99d4-aece48fb854c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:05.668780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700529ee-e5f9-49c8-8f26-13fd7ed40136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:05.669766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700529ee-e5f9-49c8-8f26-13fd7ed40136 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:05.669876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700529ee-e5f9-49c8-8f26-13fd7ed40136 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:05.670199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700529ee-e5f9-49c8-8f26-13fd7ed40136 None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:05.671398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700529ee-e5f9-49c8-8f26-13fd7ed40136 None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:05.672929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700529ee-e5f9-49c8-8f26-13fd7ed40136 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:05.676489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 189/387] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:05 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:05.681404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700529ee-e5f9-49c8-8f26-13fd7ed40136 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:05.716837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecd02e-4481-4e46-a69e-44ce9e0da0bf None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:05.733009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:05.755029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43719a-2fa6-4e95-a0ce-bf2b498abcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:05.756050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43719a-2fa6-4e95-a0ce-bf2b498abcac None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:05.756527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43719a-2fa6-4e95-a0ce-bf2b498abcac None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:05.757019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43719a-2fa6-4e95-a0ce-bf2b498abcac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:05.768237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43719a-2fa6-4e95-a0ce-bf2b498abcac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4a43719a-2fa6-4e95-a0ce-bf2b498abcac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:05.773779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:05.774681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:05.775505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:05.778191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 199/388] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:05.784166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43719a-2fa6-4e95-a0ce-bf2b498abcac None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:05.889983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700529ee-e5f9-49c8-8f26-13fd7ed40136 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:05.961295 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b9f1c-e5d6-401f-b3a3-e81a68ca9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:05.962348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b9f1c-e5d6-401f-b3a3-e81a68ca9a96 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:05.962827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b9f1c-e5d6-401f-b3a3-e81a68ca9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:05.963323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b9f1c-e5d6-401f-b3a3-e81a68ca9a96 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:05.966839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b9f1c-e5d6-401f-b3a3-e81a68ca9a96 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:05.968929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b9f1c-e5d6-401f-b3a3-e81a68ca9a96 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:05.973499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 190/389] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:05 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:05.979269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b9f1c-e5d6-401f-b3a3-e81a68ca9a96 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:05.981287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43719a-2fa6-4e95-a0ce-bf2b498abcac None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:06.013637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:06.056453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1b820-0c27-4a7b-86e9-1c03440909c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:06.057113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1b820-0c27-4a7b-86e9-1c03440909c1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:06.057502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1b820-0c27-4a7b-86e9-1c03440909c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:06.057780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1b820-0c27-4a7b-86e9-1c03440909c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:06.058551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1b820-0c27-4a7b-86e9-1c03440909c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:06.058853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1b820-0c27-4a7b-86e9-1c03440909c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:06.060283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1b820-0c27-4a7b-86e9-1c03440909c1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:06.075373 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 200/390] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:06.082643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1b820-0c27-4a7b-86e9-1c03440909c1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:06.160039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:06.171419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b9f1c-e5d6-401f-b3a3-e81a68ca9a96 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:06.240689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ddae0-ae17-4847-a279-99ae4b00564a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:06.241313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ddae0-ae17-4847-a279-99ae4b00564a None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:06.241600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ddae0-ae17-4847-a279-99ae4b00564a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:06.241878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ddae0-ae17-4847-a279-99ae4b00564a None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252/groups/5f306e444f734481bf382a7c638fc233/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:06.243981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ddae0-ae17-4847-a279-99ae4b00564a None admin] RBAC: Authorizing `identity:create_grant(project_id=8096b1508e644200a9a730939b83c252, group_id=5f306e444f734481bf382a7c638fc233, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:06.245460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ddae0-ae17-4847-a279-99ae4b00564a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:06.267632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 191/391] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 26 07:14:05 2022] PUT /identity/v3/projects/8096b1508e644200a9a730939b83c252/groups/5f306e444f734481bf382a7c638fc233/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:06.279406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1b820-0c27-4a7b-86e9-1c03440909c1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:06.319033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1ef2e-087e-4805-a474-69c4e471ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:06.319765 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1ef2e-087e-4805-a474-69c4e471ca67 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:06.320049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1ef2e-087e-4805-a474-69c4e471ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:06.320327 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1ef2e-087e-4805-a474-69c4e471ca67 None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:06.321719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1ef2e-087e-4805-a474-69c4e471ca67 None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:06.323288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1ef2e-087e-4805-a474-69c4e471ca67 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:06.325403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 201/392] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:06 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:06.333755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ddae0-ae17-4847-a279-99ae4b00564a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:06.443531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:06.479475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ddae0-ae17-4847-a279-99ae4b00564a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:06.524987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f9150-92c9-491f-a8f4-61c6f1f18e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:06.525614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9150-92c9-491f-a8f4-61c6f1f18e93 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:06.525897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9150-92c9-491f-a8f4-61c6f1f18e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:06.526174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9150-92c9-491f-a8f4-61c6f1f18e93 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:06.527374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f9150-92c9-491f-a8f4-61c6f1f18e93 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:06.528821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f9150-92c9-491f-a8f4-61c6f1f18e93 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:06.530950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 192/393] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:06 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:06.536533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1ef2e-087e-4805-a474-69c4e471ca67 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:06.619972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c66bf-dad5-4c5e-a8b5-d59d146d67e6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:06.620287 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c66bf-dad5-4c5e-a8b5-d59d146d67e6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:06.620528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c66bf-dad5-4c5e-a8b5-d59d146d67e6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:06.622751 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 193/394] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:06.628347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab4aa-5d3a-4845-84e7-6e2b0028d5ee None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:06.628688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab4aa-5d3a-4845-84e7-6e2b0028d5ee None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:06.628994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab4aa-5d3a-4845-84e7-6e2b0028d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:06.648845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-42eab4aa-5d3a-4845-84e7-6e2b0028d5ee None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:06.650172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42eab4aa-5d3a-4845-84e7-6e2b0028d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:06.657668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1ef2e-087e-4805-a474-69c4e471ca67 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:06.660166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:06.696499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff103b18-0f41-41fb-b32b-2ac52f47c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:06.697211 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103b18-0f41-41fb-b32b-2ac52f47c38a None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:06.697531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103b18-0f41-41fb-b32b-2ac52f47c38a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:06.698703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103b18-0f41-41fb-b32b-2ac52f47c38a None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252/groups/5f306e444f734481bf382a7c638fc233/roles/53cf1beeeaca4ae1b43e5399ce133329` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:06.701093 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff103b18-0f41-41fb-b32b-2ac52f47c38a None admin] RBAC: Authorizing `identity:create_grant(project_id=8096b1508e644200a9a730939b83c252, group_id=5f306e444f734481bf382a7c638fc233, role_id=53cf1beeeaca4ae1b43e5399ce133329)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:06.702616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff103b18-0f41-41fb-b32b-2ac52f47c38a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:06.725091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 202/395] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 26 07:14:06 2022] PUT /identity/v3/projects/8096b1508e644200a9a730939b83c252/groups/5f306e444f734481bf382a7c638fc233/roles/53cf1beeeaca4ae1b43e5399ce133329 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:14:06.771482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 194/396] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:06.806651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff103b18-0f41-41fb-b32b-2ac52f47c38a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:06.932812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff103b18-0f41-41fb-b32b-2ac52f47c38a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:06.969615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad586-d21f-4264-9ab5-b4767a2b811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:06.970301 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad586-d21f-4264-9ab5-b4767a2b811d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:06.970591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad586-d21f-4264-9ab5-b4767a2b811d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:06.970871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad586-d21f-4264-9ab5-b4767a2b811d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:06.982938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ad586-d21f-4264-9ab5-b4767a2b811d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-182ad586-d21f-4264-9ab5-b4767a2b811d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:06.988512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:06.989467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:06.990315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 203/397] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:06.997507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab4aa-5d3a-4845-84e7-6e2b0028d5ee None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:07.074750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:07.108829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab4aa-5d3a-4845-84e7-6e2b0028d5ee None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:07.155775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dfc5f-e8a0-4b31-8388-b5b45e144436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:07.156424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dfc5f-e8a0-4b31-8388-b5b45e144436 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:07.156702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dfc5f-e8a0-4b31-8388-b5b45e144436 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:07.156967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dfc5f-e8a0-4b31-8388-b5b45e144436 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:07.157728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dfc5f-e8a0-4b31-8388-b5b45e144436 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:07.158031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dfc5f-e8a0-4b31-8388-b5b45e144436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:07.159418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dfc5f-e8a0-4b31-8388-b5b45e144436 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:07.173313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 195/398] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:07.179452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad586-d21f-4264-9ab5-b4767a2b811d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:07.215319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:07.301163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad586-d21f-4264-9ab5-b4767a2b811d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:07.337328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabd16d-26d2-4d16-bff7-aef609293f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:07.337923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabd16d-26d2-4d16-bff7-aef609293f5e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:07.338210 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabd16d-26d2-4d16-bff7-aef609293f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:07.338493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabd16d-26d2-4d16-bff7-aef609293f5e None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:07.339716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabd16d-26d2-4d16-bff7-aef609293f5e None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:07.341214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabd16d-26d2-4d16-bff7-aef609293f5e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:07.343250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 204/399] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:07 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:07.349204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dfc5f-e8a0-4b31-8388-b5b45e144436 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:07.468858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dfc5f-e8a0-4b31-8388-b5b45e144436 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:07.504739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c78cd-1631-4aa7-add6-dde4d78fe3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:07.505484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c78cd-1631-4aa7-add6-dde4d78fe3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:07.505805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c78cd-1631-4aa7-add6-dde4d78fe3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:07.506084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c78cd-1631-4aa7-add6-dde4d78fe3f4 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:07.507278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c78cd-1631-4aa7-add6-dde4d78fe3f4 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:07.508747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c78cd-1631-4aa7-add6-dde4d78fe3f4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:07.510916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 196/400] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:07 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:07.517156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabd16d-26d2-4d16-bff7-aef609293f5e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:07.549997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138817-790d-4023-b83b-f6b91963179b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:07.550339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138817-790d-4023-b83b-f6b91963179b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:07.550670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138817-790d-4023-b83b-f6b91963179b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:07.552321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 197/401] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:07.562743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0ca87-72e6-4af0-93df-4ec478d3fed3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:07.563044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0ca87-72e6-4af0-93df-4ec478d3fed3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:07.563299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0ca87-72e6-4af0-93df-4ec478d3fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:07.576793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:07.602761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f2e0ca87-72e6-4af0-93df-4ec478d3fed3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:07.605786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f2e0ca87-72e6-4af0-93df-4ec478d3fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:07.685704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:07.696934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabd16d-26d2-4d16-bff7-aef609293f5e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:07.735949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c1c37-fb67-443c-80ec-bf9c6a9d6863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:07.737041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c1c37-fb67-443c-80ec-bf9c6a9d6863 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:07.737534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c1c37-fb67-443c-80ec-bf9c6a9d6863 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:07.738037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c1c37-fb67-443c-80ec-bf9c6a9d6863 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec/groups/5f306e444f734481bf382a7c638fc233/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:07.740880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c1c37-fb67-443c-80ec-bf9c6a9d6863 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fe9341b7bf94c7bb282049899463dec, group_id=5f306e444f734481bf382a7c638fc233, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:07.742800 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c1c37-fb67-443c-80ec-bf9c6a9d6863 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:07.762283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 205/402] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 26 07:14:07 2022] PUT /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec/groups/5f306e444f734481bf382a7c638fc233/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:07.783781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b43b-bfdc-440d-a1eb-85c27dea6127 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:07.784617 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b43b-bfdc-440d-a1eb-85c27dea6127 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:07.785389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b43b-bfdc-440d-a1eb-85c27dea6127 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:07.788431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 206/403] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:07.793761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679eb25-a39c-4344-a7a7-4073197bcb4c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:07.793945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 198/404] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:07.794503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679eb25-a39c-4344-a7a7-4073197bcb4c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:07.795075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679eb25-a39c-4344-a7a7-4073197bcb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:07.816558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e679eb25-a39c-4344-a7a7-4073197bcb4c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:07.818237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e679eb25-a39c-4344-a7a7-4073197bcb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:07.832237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0ca87-72e6-4af0-93df-4ec478d3fed3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:07.896245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 207/405] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:07.935597 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679eb25-a39c-4344-a7a7-4073197bcb4c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:08.015277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0ca87-72e6-4af0-93df-4ec478d3fed3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:08.054192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:08.060366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b233da-9e84-4a63-ad31-49b807b97137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:08.061446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b233da-9e84-4a63-ad31-49b807b97137 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:08.061930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b233da-9e84-4a63-ad31-49b807b97137 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:08.062494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b233da-9e84-4a63-ad31-49b807b97137 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:08.074472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b233da-9e84-4a63-ad31-49b807b97137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:08.074808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-69b233da-9e84-4a63-ad31-49b807b97137 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:08.079720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:08.080947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:08.082112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:08.083436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 199/406] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:08.094716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b233da-9e84-4a63-ad31-49b807b97137 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:08.099791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679eb25-a39c-4344-a7a7-4073197bcb4c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:08.174086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c360456-30d3-40f1-87c8-c3956a1f4550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:08.174672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c360456-30d3-40f1-87c8-c3956a1f4550 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:08.174947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c360456-30d3-40f1-87c8-c3956a1f4550 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:08.175214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c360456-30d3-40f1-87c8-c3956a1f4550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:08.198805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c360456-30d3-40f1-87c8-c3956a1f4550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8c360456-30d3-40f1-87c8-c3956a1f4550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:08.204892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:08.205858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:08.206713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:08.208950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 208/407] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:08.212048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c360456-30d3-40f1-87c8-c3956a1f4550 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:08.321963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b233da-9e84-4a63-ad31-49b807b97137 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:08.381962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77242f0e-1829-451e-acd4-6ec68d9f526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:08.382606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77242f0e-1829-451e-acd4-6ec68d9f526f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:08.382882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77242f0e-1829-451e-acd4-6ec68d9f526f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:08.383150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77242f0e-1829-451e-acd4-6ec68d9f526f None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:08.383883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77242f0e-1829-451e-acd4-6ec68d9f526f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:08.384183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77242f0e-1829-451e-acd4-6ec68d9f526f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:08.385641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77242f0e-1829-451e-acd4-6ec68d9f526f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:08.396041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 200/408] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:08.401350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77242f0e-1829-451e-acd4-6ec68d9f526f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:08.423638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c360456-30d3-40f1-87c8-c3956a1f4550 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:08.492750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e5945-0f8f-4931-aa90-0524195ba0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:08.493428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e5945-0f8f-4931-aa90-0524195ba0bf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:08.493704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e5945-0f8f-4931-aa90-0524195ba0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:08.493979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e5945-0f8f-4931-aa90-0524195ba0bf None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:08.494719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e5945-0f8f-4931-aa90-0524195ba0bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:08.495026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e5945-0f8f-4931-aa90-0524195ba0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:08.496484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e5945-0f8f-4931-aa90-0524195ba0bf None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:08.518375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 209/409] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:08.525285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e5945-0f8f-4931-aa90-0524195ba0bf None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:08.525484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:08.545665 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:08.610521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77242f0e-1829-451e-acd4-6ec68d9f526f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:08.681902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424389a9-a586-447e-aebc-c25bb79691e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:08.682573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424389a9-a586-447e-aebc-c25bb79691e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:08.682849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424389a9-a586-447e-aebc-c25bb79691e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:08.683120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424389a9-a586-447e-aebc-c25bb79691e2 None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:08.684511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424389a9-a586-447e-aebc-c25bb79691e2 None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:08.686005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424389a9-a586-447e-aebc-c25bb79691e2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:08.687715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 201/410] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:08 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:08.694780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424389a9-a586-447e-aebc-c25bb79691e2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:08.717699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e5945-0f8f-4931-aa90-0524195ba0bf None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:08.792717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde67cb-6691-446f-b778-9edfda8601bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:08.793807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde67cb-6691-446f-b778-9edfda8601bf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:08.794337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde67cb-6691-446f-b778-9edfda8601bf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:08.794803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde67cb-6691-446f-b778-9edfda8601bf None admin] PATH_INFO: `/v3/groups/ae715e3cea3d45719f78ee5146bc9600` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:08.796234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde67cb-6691-446f-b778-9edfda8601bf None admin] RBAC: Authorizing `identity:get_group(group_id=ae715e3cea3d45719f78ee5146bc9600)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:08.797950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde67cb-6691-446f-b778-9edfda8601bf None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:08.809810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 210/411] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:08 2022] GET /identity/v3/groups/ae715e3cea3d45719f78ee5146bc9600 => generated 229 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:08.822785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde67cb-6691-446f-b778-9edfda8601bf None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:08.829873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424389a9-a586-447e-aebc-c25bb79691e2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:08.854047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:08.866569 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2886b-17e2-4142-b71a-aa8a8d3f8650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:08.867530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2886b-17e2-4142-b71a-aa8a8d3f8650 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:08.867982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2886b-17e2-4142-b71a-aa8a8d3f8650 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:08.868433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2886b-17e2-4142-b71a-aa8a8d3f8650 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:08.869828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2886b-17e2-4142-b71a-aa8a8d3f8650 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:08.871479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2886b-17e2-4142-b71a-aa8a8d3f8650 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:08.873418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 202/412] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:08 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:08.879609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2886b-17e2-4142-b71a-aa8a8d3f8650 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:08.971390 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:09.000778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2886b-17e2-4142-b71a-aa8a8d3f8650 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:09.025334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde67cb-6691-446f-b778-9edfda8601bf None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:09.037086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916f0cd-5ea6-4193-9c4f-122aa8bba981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:09.038211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916f0cd-5ea6-4193-9c4f-122aa8bba981 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.038688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916f0cd-5ea6-4193-9c4f-122aa8bba981 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.039157 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916f0cd-5ea6-4193-9c4f-122aa8bba981 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec/groups/5f306e444f734481bf382a7c638fc233/roles/53cf1beeeaca4ae1b43e5399ce133329` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.041771 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916f0cd-5ea6-4193-9c4f-122aa8bba981 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fe9341b7bf94c7bb282049899463dec, group_id=5f306e444f734481bf382a7c638fc233, role_id=53cf1beeeaca4ae1b43e5399ce133329)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:09.043538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916f0cd-5ea6-4193-9c4f-122aa8bba981 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:09.064282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 203/413] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 26 07:14:08 2022] PUT /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec/groups/5f306e444f734481bf382a7c638fc233/roles/53cf1beeeaca4ae1b43e5399ce133329 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:09.083556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c69f6f-1002-4748-bd9d-21abd7cdc6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:09.084652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c69f6f-1002-4748-bd9d-21abd7cdc6ea None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.085198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c69f6f-1002-4748-bd9d-21abd7cdc6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.085743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c69f6f-1002-4748-bd9d-21abd7cdc6ea None admin] PATH_INFO: `/v3/projects/307d27a777014952aa29c6bcc39dc4ed` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.087326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c69f6f-1002-4748-bd9d-21abd7cdc6ea None admin] RBAC: Authorizing `identity:get_project(project_id=307d27a777014952aa29c6bcc39dc4ed)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:09.089198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c69f6f-1002-4748-bd9d-21abd7cdc6ea None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:09.096762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 211/414] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:08 2022] GET /identity/v3/projects/307d27a777014952aa29c6bcc39dc4ed => generated 344 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:09.098672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916f0cd-5ea6-4193-9c4f-122aa8bba981 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:09.110336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168b5be-8a5a-46f8-9033-6cc370991570 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.110679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168b5be-8a5a-46f8-9033-6cc370991570 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.110882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168b5be-8a5a-46f8-9033-6cc370991570 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.112521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 212/415] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:09.118158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a609d-8ff2-416c-b59e-311e9e3bfc2f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.118465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a609d-8ff2-416c-b59e-311e9e3bfc2f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.118715 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a609d-8ff2-416c-b59e-311e9e3bfc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.154919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-524a609d-8ff2-416c-b59e-311e9e3bfc2f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:09.156457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-524a609d-8ff2-416c-b59e-311e9e3bfc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:09.200902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:09.289276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 213/416] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:09.291444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53976702-d757-4317-961b-a0453d5c51ee None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.291848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53976702-d757-4317-961b-a0453d5c51ee None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.292129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53976702-d757-4317-961b-a0453d5c51ee None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.294951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 214/417] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:09.302513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916f0cd-5ea6-4193-9c4f-122aa8bba981 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:09.305884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da149c1b-8b83-44e6-a1b4-bb7ea12b67fd None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.306193 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da149c1b-8b83-44e6-a1b4-bb7ea12b67fd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.306473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da149c1b-8b83-44e6-a1b4-bb7ea12b67fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.327657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-da149c1b-8b83-44e6-a1b4-bb7ea12b67fd None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:09.328872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-da149c1b-8b83-44e6-a1b4-bb7ea12b67fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:09.353994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9260a4-6a93-4ebb-88c9-575eabf0dfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:09.354696 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9260a4-6a93-4ebb-88c9-575eabf0dfde None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.354976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9260a4-6a93-4ebb-88c9-575eabf0dfde None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.355253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9260a4-6a93-4ebb-88c9-575eabf0dfde None admin] PATH_INFO: `/v3/projects/307d27a777014952aa29c6bcc39dc4ed/groups/ae715e3cea3d45719f78ee5146bc9600/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.357226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9260a4-6a93-4ebb-88c9-575eabf0dfde None admin] RBAC: Authorizing `identity:create_grant(project_id=307d27a777014952aa29c6bcc39dc4ed, group_id=ae715e3cea3d45719f78ee5146bc9600, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:09.358684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9260a4-6a93-4ebb-88c9-575eabf0dfde None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:09.382433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 204/418] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 26 07:14:09 2022] PUT /identity/v3/projects/307d27a777014952aa29c6bcc39dc4ed/groups/ae715e3cea3d45719f78ee5146bc9600/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:09.384097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9260a4-6a93-4ebb-88c9-575eabf0dfde None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:09.399561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:09.405349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 215/419] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:09.431362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da149c1b-8b83-44e6-a1b4-bb7ea12b67fd None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:09.530525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9260a4-6a93-4ebb-88c9-575eabf0dfde None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:09.544246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:09.566407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da149c1b-8b83-44e6-a1b4-bb7ea12b67fd None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:09.574594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996454-3de8-4944-83cc-0c4b221c40a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:09.575337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996454-3de8-4944-83cc-0c4b221c40a1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.575682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996454-3de8-4944-83cc-0c4b221c40a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.576023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996454-3de8-4944-83cc-0c4b221c40a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.587618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8996454-3de8-4944-83cc-0c4b221c40a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e8996454-3de8-4944-83cc-0c4b221c40a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:09.593949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:09.594925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:09.595756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 205/420] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:09.601909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996454-3de8-4944-83cc-0c4b221c40a1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:09.617090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d86a0-a438-4ac4-9750-ade9f7d3929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:09.618217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d86a0-a438-4ac4-9750-ade9f7d3929e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.618648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d86a0-a438-4ac4-9750-ade9f7d3929e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.619069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d86a0-a438-4ac4-9750-ade9f7d3929e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.639136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d86a0-a438-4ac4-9750-ade9f7d3929e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c30d86a0-a438-4ac4-9750-ade9f7d3929e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:09.647294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:09.648443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:09.649295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:09.651937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 216/421] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:09.661791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d86a0-a438-4ac4-9750-ade9f7d3929e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:09.730012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996454-3de8-4944-83cc-0c4b221c40a1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:09.749460 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:09.767629 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab749a3-41da-4d71-b157-4d4c2a5537f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:09.768369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab749a3-41da-4d71-b157-4d4c2a5537f5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.768716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab749a3-41da-4d71-b157-4d4c2a5537f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.769165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab749a3-41da-4d71-b157-4d4c2a5537f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.770069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab749a3-41da-4d71-b157-4d4c2a5537f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:09.770448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab749a3-41da-4d71-b157-4d4c2a5537f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:09.772387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab749a3-41da-4d71-b157-4d4c2a5537f5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:09.785653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 206/422] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:09.787849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab749a3-41da-4d71-b157-4d4c2a5537f5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:09.802580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d86a0-a438-4ac4-9750-ade9f7d3929e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:09.841070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d96ba-a0d1-482a-b297-55afd786ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:09.842021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d96ba-a0d1-482a-b297-55afd786ff00 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.842601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d96ba-a0d1-482a-b297-55afd786ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.843730 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d96ba-a0d1-482a-b297-55afd786ff00 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:09.844803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d96ba-a0d1-482a-b297-55afd786ff00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:09.845347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d96ba-a0d1-482a-b297-55afd786ff00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:09.847082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d96ba-a0d1-482a-b297-55afd786ff00 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:09.853647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:09.858690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 217/423] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:09.870343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d96ba-a0d1-482a-b297-55afd786ff00 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:09.936647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab749a3-41da-4d71-b157-4d4c2a5537f5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:09.981900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9860e7-875a-4a8e-9974-3380ecaad598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:09.982544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9860e7-875a-4a8e-9974-3380ecaad598 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:09.982822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9860e7-875a-4a8e-9974-3380ecaad598 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:09.983094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9860e7-875a-4a8e-9974-3380ecaad598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:10.061409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d96ba-a0d1-482a-b297-55afd786ff00 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:10.062390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9860e7-875a-4a8e-9974-3380ecaad598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:10.065066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9860e7-875a-4a8e-9974-3380ecaad598 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:10.095015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:10.110983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5609c-3376-4bcf-bc11-53a2de4e1d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:10.111627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5609c-3376-4bcf-bc11-53a2de4e1d1e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:10.111907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5609c-3376-4bcf-bc11-53a2de4e1d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:10.112177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5609c-3376-4bcf-bc11-53a2de4e1d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:10.142639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:10.188506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5609c-3376-4bcf-bc11-53a2de4e1d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:10.190202 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5609c-3376-4bcf-bc11-53a2de4e1d1e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:10.287861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 207/424] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:10.293609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9860e7-875a-4a8e-9974-3380ecaad598 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:10.357444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 218/425] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:10.359054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aba82-98bf-4fa8-a176-bf519de01ffd None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:10.359543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aba82-98bf-4fa8-a176-bf519de01ffd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:10.360042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aba82-98bf-4fa8-a176-bf519de01ffd None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:10.361686 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 219/426] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:10.367990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b761e8c-6fb6-405b-ad9e-6b07ff04b301 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:10.368735 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b761e8c-6fb6-405b-ad9e-6b07ff04b301 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:10.369419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b761e8c-6fb6-405b-ad9e-6b07ff04b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:10.388463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3b761e8c-6fb6-405b-ad9e-6b07ff04b301 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:10.390532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3b761e8c-6fb6-405b-ad9e-6b07ff04b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:10.421714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:10.431340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9860e7-875a-4a8e-9974-3380ecaad598 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:10.463547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:10.467806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 220/427] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:10.473757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b761e8c-6fb6-405b-ad9e-6b07ff04b301 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:10.482138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd171-9310-40ff-8ede-c850c3edf53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:10.483110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd171-9310-40ff-8ede-c850c3edf53f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:10.483579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd171-9310-40ff-8ede-c850c3edf53f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:10.484018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd171-9310-40ff-8ede-c850c3edf53f None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:10.485931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedd171-9310-40ff-8ede-c850c3edf53f None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:10.487580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedd171-9310-40ff-8ede-c850c3edf53f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:10.489546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 208/428] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:10 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:10.494666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd171-9310-40ff-8ede-c850c3edf53f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:10.607182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd171-9310-40ff-8ede-c850c3edf53f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:10.609840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b761e8c-6fb6-405b-ad9e-6b07ff04b301 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:10.653829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8024c-18f0-40ae-b09d-ffd5ef9dbfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:10.654056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e62b3-6fa9-44f3-a926-41c3759fab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:10.654869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e62b3-6fa9-44f3-a926-41c3759fab86 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:10.655148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8024c-18f0-40ae-b09d-ffd5ef9dbfde None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:10.655248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e62b3-6fa9-44f3-a926-41c3759fab86 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:10.655541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e62b3-6fa9-44f3-a926-41c3759fab86 None admin] PATH_INFO: `/v3/projects/8096b1508e644200a9a730939b83c252` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:10.655865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8024c-18f0-40ae-b09d-ffd5ef9dbfde None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:10.656333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8024c-18f0-40ae-b09d-ffd5ef9dbfde None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:10.657107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e62b3-6fa9-44f3-a926-41c3759fab86 None admin] RBAC: Authorizing `identity:get_project(project_id=8096b1508e644200a9a730939b83c252)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:10.658918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e62b3-6fa9-44f3-a926-41c3759fab86 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:10.661169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 221/429] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:10 2022] GET /identity/v3/projects/8096b1508e644200a9a730939b83c252 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:10.661998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e62b3-6fa9-44f3-a926-41c3759fab86 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:10.670252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8024c-18f0-40ae-b09d-ffd5ef9dbfde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a0f8024c-18f0-40ae-b09d-ffd5ef9dbfde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:10.676022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:10.676919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:14:10.678108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:10.680749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 209/430] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:10.681839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8024c-18f0-40ae-b09d-ffd5ef9dbfde None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:10.692053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:10.769907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:10.808125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e62b3-6fa9-44f3-a926-41c3759fab86 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:10.824136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8024c-18f0-40ae-b09d-ffd5ef9dbfde None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:10.851819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d34d3-dd93-4bbd-b612-90bc2a164211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:10.852484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d34d3-dd93-4bbd-b612-90bc2a164211 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:10.852924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d34d3-dd93-4bbd-b612-90bc2a164211 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:10.853210 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d34d3-dd93-4bbd-b612-90bc2a164211 None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:10.854969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d34d3-dd93-4bbd-b612-90bc2a164211 None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:10.856970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d34d3-dd93-4bbd-b612-90bc2a164211 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:10.859837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 222/431] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:10 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:10.860855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d34d3-dd93-4bbd-b612-90bc2a164211 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:10.868420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5dfe7-d65c-4eeb-86f0-bead55c1008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:10.869996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5dfe7-d65c-4eeb-86f0-bead55c1008b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:10.870753 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5dfe7-d65c-4eeb-86f0-bead55c1008b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:10.871542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5dfe7-d65c-4eeb-86f0-bead55c1008b None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:10.873937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5dfe7-d65c-4eeb-86f0-bead55c1008b None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:10.876867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5dfe7-d65c-4eeb-86f0-bead55c1008b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:10.885580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 210/432] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:10 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:10.887130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5dfe7-d65c-4eeb-86f0-bead55c1008b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:10.982614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d34d3-dd93-4bbd-b612-90bc2a164211 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:10.985580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:11.016864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5dfe7-d65c-4eeb-86f0-bead55c1008b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:11.025607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8d408-6dc5-4923-adc0-d45b58b4be5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:11.026322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8d408-6dc5-4923-adc0-d45b58b4be5e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.026687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8d408-6dc5-4923-adc0-d45b58b4be5e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.027009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8d408-6dc5-4923-adc0-d45b58b4be5e None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.028262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8d408-6dc5-4923-adc0-d45b58b4be5e None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:11.028657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8d408-6dc5-4923-adc0-d45b58b4be5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:11.030159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8d408-6dc5-4923-adc0-d45b58b4be5e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:11.045436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 223/433] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:14:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:11.046688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8d408-6dc5-4923-adc0-d45b58b4be5e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:11.057023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:11.067219 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b14896-93cc-4d7a-86b9-974413441d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:11.067862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14896-93cc-4d7a-86b9-974413441d0e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.068143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14896-93cc-4d7a-86b9-974413441d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.068559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14896-93cc-4d7a-86b9-974413441d0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.069406 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b14896-93cc-4d7a-86b9-974413441d0e None admin] RBAC: Adding query filter params (group.id=5f306e444f734481bf382a7c638fc233, role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=8096b1508e644200a9a730939b83c252) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:11.069790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b14896-93cc-4d7a-86b9-974413441d0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:11.071213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b14896-93cc-4d7a-86b9-974413441d0e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:11.078277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 211/434] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:10 2022] GET /identity/v3/role_assignments?group.id=5f306e444f734481bf382a7c638fc233&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:11.079058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b14896-93cc-4d7a-86b9-974413441d0e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:11.186142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8d408-6dc5-4923-adc0-d45b58b4be5e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:11.214438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b14896-93cc-4d7a-86b9-974413441d0e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:11.229556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4f11a-f798-4b81-93aa-7078824deb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:11.230607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4f11a-f798-4b81-93aa-7078824deb01 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.231096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4f11a-f798-4b81-93aa-7078824deb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.231597 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4f11a-f798-4b81-93aa-7078824deb01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.233140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4f11a-f798-4b81-93aa-7078824deb01 None admin] RBAC: Adding query filter params (group.id=5f306e444f734481bf382a7c638fc233, role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=8096b1508e644200a9a730939b83c252) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:11.233747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4f11a-f798-4b81-93aa-7078824deb01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:11.236114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4f11a-f798-4b81-93aa-7078824deb01 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:11.244088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 224/435] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:11 2022] GET /identity/v3/role_assignments?group.id=5f306e444f734481bf382a7c638fc233&scope.project.id=8096b1508e644200a9a730939b83c252&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:11.282009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03d29c-99b1-411e-8d68-949dcdd827a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:11.283064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03d29c-99b1-411e-8d68-949dcdd827a0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.283571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03d29c-99b1-411e-8d68-949dcdd827a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.284047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03d29c-99b1-411e-8d68-949dcdd827a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.370089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:11.381572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03d29c-99b1-411e-8d68-949dcdd827a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:11.383181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03d29c-99b1-411e-8d68-949dcdd827a0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:11.421588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332b870-2f67-4bf5-86de-d828153bc266 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.421920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332b870-2f67-4bf5-86de-d828153bc266 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.422234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332b870-2f67-4bf5-86de-d828153bc266 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.425651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 225/436] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:14:11.432217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed417d0f-fdbc-41b0-9fa6-30fcd87411e0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.432523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed417d0f-fdbc-41b0-9fa6-30fcd87411e0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.432770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed417d0f-fdbc-41b0-9fa6-30fcd87411e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.457622 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ed417d0f-fdbc-41b0-9fa6-30fcd87411e0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:11.458874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ed417d0f-fdbc-41b0-9fa6-30fcd87411e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:11.473693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:11.520080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 212/437] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:11.527565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03d29c-99b1-411e-8d68-949dcdd827a0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:11.568274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 226/438] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:11.597088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed417d0f-fdbc-41b0-9fa6-30fcd87411e0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:11.665434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:11.676146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03d29c-99b1-411e-8d68-949dcdd827a0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:11.723569 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459c8b0-6126-4b50-85f9-f9b5df88ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:11.724145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459c8b0-6126-4b50-85f9-f9b5df88ec03 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.725210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459c8b0-6126-4b50-85f9-f9b5df88ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.725210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459c8b0-6126-4b50-85f9-f9b5df88ec03 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.726273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459c8b0-6126-4b50-85f9-f9b5df88ec03 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:11.727744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459c8b0-6126-4b50-85f9-f9b5df88ec03 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:11.729875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 213/439] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:11 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:11.736822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459c8b0-6126-4b50-85f9-f9b5df88ec03 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:11.746883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed417d0f-fdbc-41b0-9fa6-30fcd87411e0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:11.789619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e8378-4a08-4237-8579-669c66903f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:11.790288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e8378-4a08-4237-8579-669c66903f20 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.790655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e8378-4a08-4237-8579-669c66903f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.790820 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e8378-4a08-4237-8579-669c66903f20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.803573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e8378-4a08-4237-8579-669c66903f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5a9e8378-4a08-4237-8579-669c66903f20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:11.811991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:11.812965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 227/440] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:11.822247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59019d2-c0b3-4f15-ad47-a0e5c3b996ab None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.823876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59019d2-c0b3-4f15-ad47-a0e5c3b996ab None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.823876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59019d2-c0b3-4f15-ad47-a0e5c3b996ab None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.823876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 228/441] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:11.823876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59019d2-c0b3-4f15-ad47-a0e5c3b996ab None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:11.827189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:11.871036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459c8b0-6126-4b50-85f9-f9b5df88ec03 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:11.911536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652fe00-cdb1-4de5-9439-ed9e445f7ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:11.912200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652fe00-cdb1-4de5-9439-ed9e445f7ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.912482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652fe00-cdb1-4de5-9439-ed9e445f7ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.912764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652fe00-cdb1-4de5-9439-ed9e445f7ec6 None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.914015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652fe00-cdb1-4de5-9439-ed9e445f7ec6 None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:11.915466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652fe00-cdb1-4de5-9439-ed9e445f7ec6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:11.917471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 214/442] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:11 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:11.919116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9910b5b-8879-463e-9dc6-b5f0ba7e6c29 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.919396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9910b5b-8879-463e-9dc6-b5f0ba7e6c29 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.919664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9910b5b-8879-463e-9dc6-b5f0ba7e6c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.939353 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f9910b5b-8879-463e-9dc6-b5f0ba7e6c29 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:11.940537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f9910b5b-8879-463e-9dc6-b5f0ba7e6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:11.941707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59019d2-c0b3-4f15-ad47-a0e5c3b996ab None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:11.967037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:11.979220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4398437-3a32-4390-b6fc-fd8cebce45c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:11.979777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4398437-3a32-4390-b6fc-fd8cebce45c8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:11.980055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4398437-3a32-4390-b6fc-fd8cebce45c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:11.980331 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4398437-3a32-4390-b6fc-fd8cebce45c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:11.981061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4398437-3a32-4390-b6fc-fd8cebce45c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:11.981404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4398437-3a32-4390-b6fc-fd8cebce45c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:11.982799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4398437-3a32-4390-b6fc-fd8cebce45c8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:11.991092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 229/443] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:11.991911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4398437-3a32-4390-b6fc-fd8cebce45c8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:12.013664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 215/444] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:12.014515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9910b5b-8879-463e-9dc6-b5f0ba7e6c29 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:12.059016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:12.096027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4398437-3a32-4390-b6fc-fd8cebce45c8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:12.125783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9910b5b-8879-463e-9dc6-b5f0ba7e6c29 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:12.132040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be76a5-71c5-455f-aef5-c28dd3baa569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:12.132665 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be76a5-71c5-455f-aef5-c28dd3baa569 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:12.132961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be76a5-71c5-455f-aef5-c28dd3baa569 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:12.133217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be76a5-71c5-455f-aef5-c28dd3baa569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:12.134043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be76a5-71c5-455f-aef5-c28dd3baa569 None admin] RBAC: Adding query filter params (group.id=5f306e444f734481bf382a7c638fc233, role.id=c0c80af8168f45fc9fffd24abe0136f3, scope.project.id=6fe9341b7bf94c7bb282049899463dec) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:12.134349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be76a5-71c5-455f-aef5-c28dd3baa569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:12.135785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be76a5-71c5-455f-aef5-c28dd3baa569 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:12.141847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 230/445] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:11 2022] GET /identity/v3/role_assignments?group.id=5f306e444f734481bf382a7c638fc233&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=c0c80af8168f45fc9fffd24abe0136f3 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:12.142616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be76a5-71c5-455f-aef5-c28dd3baa569 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:12.162138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c54ac-e752-4342-be15-35d422c64935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:12.162801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c54ac-e752-4342-be15-35d422c64935 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:12.163083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c54ac-e752-4342-be15-35d422c64935 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:12.163359 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c54ac-e752-4342-be15-35d422c64935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:12.194115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:12.246113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c54ac-e752-4342-be15-35d422c64935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:12.247520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c54ac-e752-4342-be15-35d422c64935 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:12.267767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be76a5-71c5-455f-aef5-c28dd3baa569 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:12.306144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:12.314328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97101f29-2ddc-4ab6-a9e1-4a58e81f7530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:12.316053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97101f29-2ddc-4ab6-a9e1-4a58e81f7530 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:12.316053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97101f29-2ddc-4ab6-a9e1-4a58e81f7530 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:12.316053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97101f29-2ddc-4ab6-a9e1-4a58e81f7530 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:12.328125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97101f29-2ddc-4ab6-a9e1-4a58e81f7530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-97101f29-2ddc-4ab6-a9e1-4a58e81f7530 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:12.332858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:12.333801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:12.334634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:12.335250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 231/446] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:12.340970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97101f29-2ddc-4ab6-a9e1-4a58e81f7530 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:12.371485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 216/447] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:12.376777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c54ac-e752-4342-be15-35d422c64935 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:12.448796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:12.468827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97101f29-2ddc-4ab6-a9e1-4a58e81f7530 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:12.506792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c54ac-e752-4342-be15-35d422c64935 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:12.507313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c2194-4107-49b1-ad22-de189adc2dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:12.507959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c2194-4107-49b1-ad22-de189adc2dce None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:12.508415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c2194-4107-49b1-ad22-de189adc2dce None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:12.508697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c2194-4107-49b1-ad22-de189adc2dce None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:12.509763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c2194-4107-49b1-ad22-de189adc2dce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:12.509939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c2194-4107-49b1-ad22-de189adc2dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:12.511315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c2194-4107-49b1-ad22-de189adc2dce None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:12.523153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 232/448] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:12.528700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c2194-4107-49b1-ad22-de189adc2dce None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:12.547204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f53989-e750-427f-a5ae-1e85ebc3c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:12.547858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f53989-e750-427f-a5ae-1e85ebc3c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:12.548135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f53989-e750-427f-a5ae-1e85ebc3c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:12.548400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f53989-e750-427f-a5ae-1e85ebc3c1c3 None admin] PATH_INFO: `/v3/projects/6fe9341b7bf94c7bb282049899463dec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:12.549580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f53989-e750-427f-a5ae-1e85ebc3c1c3 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe9341b7bf94c7bb282049899463dec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:12.551222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f53989-e750-427f-a5ae-1e85ebc3c1c3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:12.552901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 217/449] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:12 2022] GET /identity/v3/projects/6fe9341b7bf94c7bb282049899463dec => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:12.558379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f53989-e750-427f-a5ae-1e85ebc3c1c3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:12.593979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:12.648027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c2194-4107-49b1-ad22-de189adc2dce None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:12.670229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f53989-e750-427f-a5ae-1e85ebc3c1c3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:12.684635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec48fd-430f-4200-a97a-9a4ba4b7166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:12.685300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec48fd-430f-4200-a97a-9a4ba4b7166c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:12.685596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec48fd-430f-4200-a97a-9a4ba4b7166c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:12.685875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec48fd-430f-4200-a97a-9a4ba4b7166c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:12.695685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:12.706413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfeb54-ff01-476e-b4a9-a6007891f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:12.707194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfeb54-ff01-476e-b4a9-a6007891f213 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:12.707465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfeb54-ff01-476e-b4a9-a6007891f213 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:12.707748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfeb54-ff01-476e-b4a9-a6007891f213 None admin] PATH_INFO: `/v3/groups/5f306e444f734481bf382a7c638fc233` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:12.708914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfeb54-ff01-476e-b4a9-a6007891f213 None admin] RBAC: Authorizing `identity:get_group(group_id=5f306e444f734481bf382a7c638fc233)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:12.710386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfeb54-ff01-476e-b4a9-a6007891f213 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:12.712000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 218/450] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:12 2022] GET /identity/v3/groups/5f306e444f734481bf382a7c638fc233 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:12.718046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfeb54-ff01-476e-b4a9-a6007891f213 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:12.757429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec48fd-430f-4200-a97a-9a4ba4b7166c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:12.759122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec48fd-430f-4200-a97a-9a4ba4b7166c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:12.810374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:12.816050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfeb54-ff01-476e-b4a9-a6007891f213 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:12.849050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475978c-41e2-445a-afce-d610642b45db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:12.849720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475978c-41e2-445a-afce-d610642b45db None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:12.849998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475978c-41e2-445a-afce-d610642b45db None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:12.850279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475978c-41e2-445a-afce-d610642b45db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:12.851078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475978c-41e2-445a-afce-d610642b45db None admin] RBAC: Adding query filter params (group.id=5f306e444f734481bf382a7c638fc233, role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=6fe9341b7bf94c7bb282049899463dec) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:12.851388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475978c-41e2-445a-afce-d610642b45db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:12.852826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475978c-41e2-445a-afce-d610642b45db None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:12.858599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 219/451] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:12 2022] GET /identity/v3/role_assignments?group.id=5f306e444f734481bf382a7c638fc233&scope.project.id=6fe9341b7bf94c7bb282049899463dec&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:12.866555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 233/452] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 07:14:12.872566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475978c-41e2-445a-afce-d610642b45db None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:12.938868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:12.990384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475978c-41e2-445a-afce-d610642b45db None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:13.028855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8729a6d-1a61-45df-8829-1b6a36ac9bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:13.029458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8729a6d-1a61-45df-8829-1b6a36ac9bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:13.029749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8729a6d-1a61-45df-8829-1b6a36ac9bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:13.030011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8729a6d-1a61-45df-8829-1b6a36ac9bd6 None admin] PATH_INFO: `/v3/projects/307d27a777014952aa29c6bcc39dc4ed` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:13.031203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8729a6d-1a61-45df-8829-1b6a36ac9bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=307d27a777014952aa29c6bcc39dc4ed)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:13.032641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8729a6d-1a61-45df-8829-1b6a36ac9bd6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:13.034577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 220/453] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:14:12 2022] GET /identity/v3/projects/307d27a777014952aa29c6bcc39dc4ed => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:13.040233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec48fd-430f-4200-a97a-9a4ba4b7166c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:13.145657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec48fd-430f-4200-a97a-9a4ba4b7166c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:13.179745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee021ab2-5066-4d44-a74d-19f0e6544f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:13.180415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee021ab2-5066-4d44-a74d-19f0e6544f5f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:13.180705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee021ab2-5066-4d44-a74d-19f0e6544f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:13.181252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee021ab2-5066-4d44-a74d-19f0e6544f5f None admin] PATH_INFO: `/v3/groups/ae715e3cea3d45719f78ee5146bc9600` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:13.182484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee021ab2-5066-4d44-a74d-19f0e6544f5f None admin] RBAC: Authorizing `identity:get_group(group_id=ae715e3cea3d45719f78ee5146bc9600)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:13.183978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee021ab2-5066-4d44-a74d-19f0e6544f5f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:13.189594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 234/454] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 26 07:14:13 2022] GET /identity/v3/groups/ae715e3cea3d45719f78ee5146bc9600 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:13.191670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8729a6d-1a61-45df-8829-1b6a36ac9bd6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:13.300264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8729a6d-1a61-45df-8829-1b6a36ac9bd6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:13.325727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:13.336639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fe0ce-068a-4ee7-8cfd-f25516692f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:13.337630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe0ce-068a-4ee7-8cfd-f25516692f35 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:13.338050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe0ce-068a-4ee7-8cfd-f25516692f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:13.338461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe0ce-068a-4ee7-8cfd-f25516692f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:13.339711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fe0ce-068a-4ee7-8cfd-f25516692f35 None admin] RBAC: Adding query filter params (group.id=ae715e3cea3d45719f78ee5146bc9600, role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=307d27a777014952aa29c6bcc39dc4ed) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:13.340189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fe0ce-068a-4ee7-8cfd-f25516692f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:13.342508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fe0ce-068a-4ee7-8cfd-f25516692f35 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:13.352095 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 221/455] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 26 07:14:13 2022] GET /identity/v3/role_assignments?group.id=ae715e3cea3d45719f78ee5146bc9600&scope.project.id=307d27a777014952aa29c6bcc39dc4ed&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:15.917191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35116-c6ab-4ecf-90a2-e61ea6d38082 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:15.917736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35116-c6ab-4ecf-90a2-e61ea6d38082 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:15.917736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35116-c6ab-4ecf-90a2-e61ea6d38082 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:15.919329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 235/456] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:15.924284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86844d6-f68b-4a81-9dc1-0c20dd40d6f9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:15.924724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86844d6-f68b-4a81-9dc1-0c20dd40d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:15.924823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86844d6-f68b-4a81-9dc1-0c20dd40d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:15.948016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d86844d6-f68b-4a81-9dc1-0c20dd40d6f9 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:15.949399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d86844d6-f68b-4a81-9dc1-0c20dd40d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:15.957999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014869-0e67-4214-bb6d-64cc4cba4fcf None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:15.958613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014869-0e67-4214-bb6d-64cc4cba4fcf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:15.959118 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014869-0e67-4214-bb6d-64cc4cba4fcf None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:15.960972 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 236/457] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:15.967230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94319db3-9425-4a9c-b486-7b78b7db9961 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:15.967503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94319db3-9425-4a9c-b486-7b78b7db9961 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:15.967940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94319db3-9425-4a9c-b486-7b78b7db9961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.007831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-94319db3-9425-4a9c-b486-7b78b7db9961 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:16.009784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-94319db3-9425-4a9c-b486-7b78b7db9961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:16.041662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:16.082268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 222/458] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:16.117849 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 237/459] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:16.126347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86844d6-f68b-4a81-9dc1-0c20dd40d6f9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:16.158305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94319db3-9425-4a9c-b486-7b78b7db9961 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:16.299186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94319db3-9425-4a9c-b486-7b78b7db9961 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:16.304351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86844d6-f68b-4a81-9dc1-0c20dd40d6f9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:16.326050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:16.340509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0be72-ebc8-4aa1-8615-771e619ef0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:16.341712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0be72-ebc8-4aa1-8615-771e619ef0aa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.342170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc00ba1-b517-4a7c-a4b9-de0052fd48f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:16.342318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0be72-ebc8-4aa1-8615-771e619ef0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.342635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0be72-ebc8-4aa1-8615-771e619ef0aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.343600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc00ba1-b517-4a7c-a4b9-de0052fd48f3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.344073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc00ba1-b517-4a7c-a4b9-de0052fd48f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.344511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc00ba1-b517-4a7c-a4b9-de0052fd48f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.355109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0be72-ebc8-4aa1-8615-771e619ef0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:16.356648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc00ba1-b517-4a7c-a4b9-de0052fd48f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:16.356763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0be72-ebc8-4aa1-8615-771e619ef0aa None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:16.358471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc00ba1-b517-4a7c-a4b9-de0052fd48f3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1bd0be72-ebc8-4aa1-8615-771e619ef0aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:16.374158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:16.375212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:16.376079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:16.376079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:16.376079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:16.376079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:16.376079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 238/460] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:16.376997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74fa15-f611-4786-9d8c-ed16129921db None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.377298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74fa15-f611-4786-9d8c-ed16129921db None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.377576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74fa15-f611-4786-9d8c-ed16129921db None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-dcc00ba1-b517-4a7c-a4b9-de0052fd48f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:16.377957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:16.378839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:16.379714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:16.379714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:16.379714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:16.379714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:16.379937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 239/461] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:16.382084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 223/462] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:16.386700 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd6438-4090-4bda-8838-a8852876fe21 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.387131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74fa15-f611-4786-9d8c-ed16129921db None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:16.388086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd6438-4090-4bda-8838-a8852876fe21 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.389003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd6438-4090-4bda-8838-a8852876fe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.391437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:16.418647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-41bd6438-4090-4bda-8838-a8852876fe21 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:16.421422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-41bd6438-4090-4bda-8838-a8852876fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:16.511403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74fa15-f611-4786-9d8c-ed16129921db None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:16.513344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 224/463] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:16.514708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd6438-4090-4bda-8838-a8852876fe21 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:16.562892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a2c72-2e77-406d-9085-9f6701e520c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:16.563777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a2c72-2e77-406d-9085-9f6701e520c5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.564227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a2c72-2e77-406d-9085-9f6701e520c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.564669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a2c72-2e77-406d-9085-9f6701e520c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.565557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a2c72-2e77-406d-9085-9f6701e520c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:16.566410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a2c72-2e77-406d-9085-9f6701e520c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:16.568943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a2c72-2e77-406d-9085-9f6701e520c5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:16.583364 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 240/464] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:16.584554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a2c72-2e77-406d-9085-9f6701e520c5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:16.648851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd6438-4090-4bda-8838-a8852876fe21 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:16.650713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:16.654414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:16.687700 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f50675-49eb-4acd-8c15-9c1ad19b8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:16.688343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f50675-49eb-4acd-8c15-9c1ad19b8e8e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.688624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f50675-49eb-4acd-8c15-9c1ad19b8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.688898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f50675-49eb-4acd-8c15-9c1ad19b8e8e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.689631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f50675-49eb-4acd-8c15-9c1ad19b8e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:16.689935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f50675-49eb-4acd-8c15-9c1ad19b8e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:16.691395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f50675-49eb-4acd-8c15-9c1ad19b8e8e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:16.699291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a2c72-2e77-406d-9085-9f6701e520c5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:16.712817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 225/465] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:16.714735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826f6b8-fa58-4414-89e1-bc46e6347230 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.715031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826f6b8-fa58-4414-89e1-bc46e6347230 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.715458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826f6b8-fa58-4414-89e1-bc46e6347230 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.716978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 226/466] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:16.717847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826f6b8-fa58-4414-89e1-bc46e6347230 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:16.743802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01bee-24b0-4968-b0f4-a25a679d3589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:16.744526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01bee-24b0-4968-b0f4-a25a679d3589 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.745365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01bee-24b0-4968-b0f4-a25a679d3589 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.745676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01bee-24b0-4968-b0f4-a25a679d3589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.760713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef01bee-24b0-4968-b0f4-a25a679d3589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:16.762235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef01bee-24b0-4968-b0f4-a25a679d3589 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-bef01bee-24b0-4968-b0f4-a25a679d3589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:16.782231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:16.783166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:16.784026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:16.784026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:16.784026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:16.784026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:16.784026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 241/467] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:16.784899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01bee-24b0-4968-b0f4-a25a679d3589 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:16.835509 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826f6b8-fa58-4414-89e1-bc46e6347230 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:16.874005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7255a-8e98-4e8b-968d-ec6c3c6dfabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:16.874653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7255a-8e98-4e8b-968d-ec6c3c6dfabf None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.874934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7255a-8e98-4e8b-968d-ec6c3c6dfabf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.875209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7255a-8e98-4e8b-968d-ec6c3c6dfabf None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.875933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7255a-8e98-4e8b-968d-ec6c3c6dfabf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:16.877470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7255a-8e98-4e8b-968d-ec6c3c6dfabf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:16.905333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 227/468] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:14:16 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:14:16.905333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d9ae-9c93-488b-b296-26499f727f0c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.905333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d9ae-9c93-488b-b296-26499f727f0c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.905333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d9ae-9c93-488b-b296-26499f727f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.907512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01bee-24b0-4968-b0f4-a25a679d3589 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:16.923978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d786d9ae-9c93-488b-b296-26499f727f0c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:16.925682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d786d9ae-9c93-488b-b296-26499f727f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:16.941312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:16.944974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:16.974060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f93481-e4de-4c94-90a1-0697804ce070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:16.975204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f93481-e4de-4c94-90a1-0697804ce070 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:16.975836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f93481-e4de-4c94-90a1-0697804ce070 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:16.976402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f93481-e4de-4c94-90a1-0697804ce070 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:16.977500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f93481-e4de-4c94-90a1-0697804ce070 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:16.979335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f93481-e4de-4c94-90a1-0697804ce070 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:17.006377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 242/469] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:14:16 2022] POST /identity/v3/users => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:14:17.008153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f93481-e4de-4c94-90a1-0697804ce070 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:17.023236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 228/470] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:17.049064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786d9ae-9c93-488b-b296-26499f727f0c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:17.163229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f93481-e4de-4c94-90a1-0697804ce070 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:17.175398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786d9ae-9c93-488b-b296-26499f727f0c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:17.212646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953addd-afd3-4d38-a9c3-4ac7a8464c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:17.214400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953addd-afd3-4d38-a9c3-4ac7a8464c23 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:17.214400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953addd-afd3-4d38-a9c3-4ac7a8464c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:17.214400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953addd-afd3-4d38-a9c3-4ac7a8464c23 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:17.214673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953addd-afd3-4d38-a9c3-4ac7a8464c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:17.214946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953addd-afd3-4d38-a9c3-4ac7a8464c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:17.216404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953addd-afd3-4d38-a9c3-4ac7a8464c23 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:17.232261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52b904-3fb9-4e63-af8b-c908bc35d9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:17.232943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52b904-3fb9-4e63-af8b-c908bc35d9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:17.233220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52b904-3fb9-4e63-af8b-c908bc35d9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:17.233527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52b904-3fb9-4e63-af8b-c908bc35d9e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:17.234553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 243/471] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:17.236201 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dd750-4e51-4fb7-8293-9a5d9fb20aff None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:17.236800 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dd750-4e51-4fb7-8293-9a5d9fb20aff None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:17.237125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dd750-4e51-4fb7-8293-9a5d9fb20aff None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:17.239004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 244/472] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:17.243292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dd750-4e51-4fb7-8293-9a5d9fb20aff None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:17.246729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52b904-3fb9-4e63-af8b-c908bc35d9e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:17.248275 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52b904-3fb9-4e63-af8b-c908bc35d9e7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:17.261027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-aa52b904-3fb9-4e63-af8b-c908bc35d9e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:17.267685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:17.268655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:17.269683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:17.269683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:17.269683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:17.269683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:17.269683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 229/473] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:17.270926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745719a-25c7-4da4-b130-232c7bc81129 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:17.271213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745719a-25c7-4da4-b130-232c7bc81129 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:17.271492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745719a-25c7-4da4-b130-232c7bc81129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:17.282355 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:17.296168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9745719a-25c7-4da4-b130-232c7bc81129 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:17.298161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9745719a-25c7-4da4-b130-232c7bc81129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:17.376184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dd750-4e51-4fb7-8293-9a5d9fb20aff None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:17.391115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 230/474] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:17.392554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745719a-25c7-4da4-b130-232c7bc81129 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:17.436293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1750-0b76-48e0-867a-f99465968bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:17.437128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1750-0b76-48e0-867a-f99465968bd4 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:17.437548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1750-0b76-48e0-867a-f99465968bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:17.438191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1750-0b76-48e0-867a-f99465968bd4 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:17.438980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e1750-0b76-48e0-867a-f99465968bd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:17.440535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e1750-0b76-48e0-867a-f99465968bd4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:17.463324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 245/475] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:14:17 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:14:17.464399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1750-0b76-48e0-867a-f99465968bd4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:17.583830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:17.592511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745719a-25c7-4da4-b130-232c7bc81129 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:17.618536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1750-0b76-48e0-867a-f99465968bd4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:17.654474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:17.664628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b86d9-a7cc-4290-b0ce-c0d453f29815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:17.665306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b86d9-a7cc-4290-b0ce-c0d453f29815 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:17.665596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b86d9-a7cc-4290-b0ce-c0d453f29815 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:17.665871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b86d9-a7cc-4290-b0ce-c0d453f29815 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:17.666588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b86d9-a7cc-4290-b0ce-c0d453f29815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:17.666897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b86d9-a7cc-4290-b0ce-c0d453f29815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:17.668366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b86d9-a7cc-4290-b0ce-c0d453f29815 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:17.683251 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 231/476] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:17.687008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:17.688304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:17.688802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:17.689036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b86d9-a7cc-4290-b0ce-c0d453f29815 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:17.689631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:17.690575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:17.692488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:17.702250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.sql.core [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 07:14:17.702250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 07:14:17.702250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [parameters: {'id': 'd02b190e66274a628adc03a492561c7f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 07:14:17.702250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80191) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 26 07:14:17.723828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:14:17.724822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application yield resource Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise self.value Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application session.commit() Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 07:14:17.725773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.flush() Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application compat.raise_( Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 07:14:17.726679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:14:17.727676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:14:17.728506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [parameters: {'id': 'd02b190e66274a628adc03a492561c7f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:17.730829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 07:14:17.732938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:17.737250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 246/477] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 26 07:14:17 2022] POST /identity/v3/roles => generated 144 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:17.744839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:17.820267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b86d9-a7cc-4290-b0ce-c0d453f29815 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:17.871824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd07d2a-cbc5-4c4d-924a-d98152e59f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:17.872815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd07d2a-cbc5-4c4d-924a-d98152e59f5f None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:17.873534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd07d2a-cbc5-4c4d-924a-d98152e59f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:17.873991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd07d2a-cbc5-4c4d-924a-d98152e59f5f None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:17.875254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd07d2a-cbc5-4c4d-924a-d98152e59f5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:17.877193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd07d2a-cbc5-4c4d-924a-d98152e59f5f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:17.911319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 232/478] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:14:17 2022] POST /identity/v3/users => generated 249 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:14:17.935956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e0beb-ae4d-467c-854e-9342929deee9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:17.976920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7699147-84c7-4568-b822-5deaba8bc660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:17.978379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7699147-84c7-4568-b822-5deaba8bc660 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:17.978861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7699147-84c7-4568-b822-5deaba8bc660 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:17.979311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7699147-84c7-4568-b822-5deaba8bc660 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:17.992256 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7699147-84c7-4568-b822-5deaba8bc660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d7699147-84c7-4568-b822-5deaba8bc660 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:17.998287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:17.999280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:14:18.000087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:18.002623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 247/479] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:18.008791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd07d2a-cbc5-4c4d-924a-d98152e59f5f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:18.076934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:18.202848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd07d2a-cbc5-4c4d-924a-d98152e59f5f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:18.268391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505219b5-05a0-4849-ac33-18a792c1c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:18.269346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505219b5-05a0-4849-ac33-18a792c1c760 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:18.269838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505219b5-05a0-4849-ac33-18a792c1c760 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:18.270251 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505219b5-05a0-4849-ac33-18a792c1c760 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:18.271143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505219b5-05a0-4849-ac33-18a792c1c760 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:18.271583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505219b5-05a0-4849-ac33-18a792c1c760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:18.273216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505219b5-05a0-4849-ac33-18a792c1c760 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:18.282860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 233/480] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:20.014166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e40cac-14bb-4d96-996d-7b030a045d54 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.016105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e40cac-14bb-4d96-996d-7b030a045d54 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.016868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e40cac-14bb-4d96-996d-7b030a045d54 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.021013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 248/481] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:20.031162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2c01-4c69-4a68-945c-b25829eb7bf3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.032962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2c01-4c69-4a68-945c-b25829eb7bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.033766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2c01-4c69-4a68-945c-b25829eb7bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.077887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cabf2c01-4c69-4a68-945c-b25829eb7bf3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:20.080327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cabf2c01-4c69-4a68-945c-b25829eb7bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:20.084077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd882-400b-4a44-8dcf-b17ce6c11ca4 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.084452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd882-400b-4a44-8dcf-b17ce6c11ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.084685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd882-400b-4a44-8dcf-b17ce6c11ca4 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.089297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 249/482] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:14:20.094135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a4740-af1e-4fe2-8130-36dfaf5788ec None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.094461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a4740-af1e-4fe2-8130-36dfaf5788ec None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.094801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a4740-af1e-4fe2-8130-36dfaf5788ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.131781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6d6a4740-af1e-4fe2-8130-36dfaf5788ec None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:20.133032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6d6a4740-af1e-4fe2-8130-36dfaf5788ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:20.142381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:20.233853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 250/483] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:20.248582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 234/484] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:20.258306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a4740-af1e-4fe2-8130-36dfaf5788ec None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:20.288001 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2c01-4c69-4a68-945c-b25829eb7bf3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:20.395356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:20.445313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a4740-af1e-4fe2-8130-36dfaf5788ec None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:20.480846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2c01-4c69-4a68-945c-b25829eb7bf3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:20.486242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308715e3-0c64-4683-8b34-4f8325abc3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:20.487191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308715e3-0c64-4683-8b34-4f8325abc3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.487706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308715e3-0c64-4683-8b34-4f8325abc3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.488209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308715e3-0c64-4683-8b34-4f8325abc3f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.497915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:20.504106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308715e3-0c64-4683-8b34-4f8325abc3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-308715e3-0c64-4683-8b34-4f8325abc3f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:20.513896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:20.514918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:20.515736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:20.518442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 251/485] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:20.522307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a32d1a-63f4-4ea4-83bb-5f299e43545a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.522500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a32d1a-63f4-4ea4-83bb-5f299e43545a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.522722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a32d1a-63f4-4ea4-83bb-5f299e43545a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.527383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 252/486] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:20.527383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a32d1a-63f4-4ea4-83bb-5f299e43545a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:20.546573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244db7f3-efca-4f17-8ae5-44d22241cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:20.547336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244db7f3-efca-4f17-8ae5-44d22241cee0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.547710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244db7f3-efca-4f17-8ae5-44d22241cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.548228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244db7f3-efca-4f17-8ae5-44d22241cee0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.563849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244db7f3-efca-4f17-8ae5-44d22241cee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-244db7f3-efca-4f17-8ae5-44d22241cee0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:20.569247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:20.570455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:20.571465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:20.577916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 235/487] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:20.577916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734557-bee7-4791-a1db-860f760d6586 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.577916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734557-bee7-4791-a1db-860f760d6586 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.577916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734557-bee7-4791-a1db-860f760d6586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.595739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d8734557-bee7-4791-a1db-860f760d6586 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:20.597224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d8734557-bee7-4791-a1db-860f760d6586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:20.690299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a32d1a-63f4-4ea4-83bb-5f299e43545a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:20.705377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 236/488] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:20.710384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734557-bee7-4791-a1db-860f760d6586 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:20.756666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:20.764536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2783-dcae-4a2d-a259-07f534135b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:20.766243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2783-dcae-4a2d-a259-07f534135b25 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.766704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2783-dcae-4a2d-a259-07f534135b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.767489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2783-dcae-4a2d-a259-07f534135b25 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.774793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2783-dcae-4a2d-a259-07f534135b25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:20.776862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2783-dcae-4a2d-a259-07f534135b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:20.779950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2783-dcae-4a2d-a259-07f534135b25 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:20.801343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 253/489] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:20.803863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2783-dcae-4a2d-a259-07f534135b25 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:20.884109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734557-bee7-4791-a1db-860f760d6586 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:20.913961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:20.934415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a13b2-9a47-4897-87eb-8d03e79a87bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:20.935484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a13b2-9a47-4897-87eb-8d03e79a87bf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:20.936025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a13b2-9a47-4897-87eb-8d03e79a87bf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:20.936487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a13b2-9a47-4897-87eb-8d03e79a87bf None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:20.937463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a13b2-9a47-4897-87eb-8d03e79a87bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:20.937960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a13b2-9a47-4897-87eb-8d03e79a87bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:20.939799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a13b2-9a47-4897-87eb-8d03e79a87bf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:20.951471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 237/490] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:20.953019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a13b2-9a47-4897-87eb-8d03e79a87bf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:20.980280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2783-dcae-4a2d-a259-07f534135b25 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.019826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb48f3-0f9c-4cce-8ec5-35ced5d73932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.022135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb48f3-0f9c-4cce-8ec5-35ced5d73932 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.022821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb48f3-0f9c-4cce-8ec5-35ced5d73932 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.023344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb48f3-0f9c-4cce-8ec5-35ced5d73932 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.041934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb48f3-0f9c-4cce-8ec5-35ced5d73932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-78cb48f3-0f9c-4cce-8ec5-35ced5d73932 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:21.051447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:21.052441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:21.053745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:21.054401 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 254/491] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:21.056161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c058b7-1f72-418b-bff3-e62de0b6a3ea None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.056650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c058b7-1f72-418b-bff3-e62de0b6a3ea None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.057124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c058b7-1f72-418b-bff3-e62de0b6a3ea None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.063926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 255/492] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:21.063926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c058b7-1f72-418b-bff3-e62de0b6a3ea None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.099538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:21.114420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a13b2-9a47-4897-87eb-8d03e79a87bf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.156818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d7330-a068-49e4-931f-002eb0ccfd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.157834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d7330-a068-49e4-931f-002eb0ccfd33 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.158316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d7330-a068-49e4-931f-002eb0ccfd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.158754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d7330-a068-49e4-931f-002eb0ccfd33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.170997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d7330-a068-49e4-931f-002eb0ccfd33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:21.172779 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d7330-a068-49e4-931f-002eb0ccfd33 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:21.184198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c058b7-1f72-418b-bff3-e62de0b6a3ea None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-083d7330-a068-49e4-931f-002eb0ccfd33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:21.190847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:21.192079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:21.192998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:21.192998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:21.192998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:21.192998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:21.194308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 238/493] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:21.195706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d7330-a068-49e4-931f-002eb0ccfd33 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.215644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:21.233892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62813c32-3ee5-4201-ad6a-5ca1dd75d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.234606 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62813c32-3ee5-4201-ad6a-5ca1dd75d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.234935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62813c32-3ee5-4201-ad6a-5ca1dd75d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.235180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62813c32-3ee5-4201-ad6a-5ca1dd75d5c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.248226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62813c32-3ee5-4201-ad6a-5ca1dd75d5c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:21.249576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62813c32-3ee5-4201-ad6a-5ca1dd75d5c1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-62813c32-3ee5-4201-ad6a-5ca1dd75d5c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:21.266632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:21.267601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:21.268497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:21.268497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:21.268497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:21.268497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:21.268497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 256/494] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:21.269476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233152be-57c7-43f1-a6f9-02efd9bed5c8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.269476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233152be-57c7-43f1-a6f9-02efd9bed5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.269602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233152be-57c7-43f1-a6f9-02efd9bed5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.296692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-233152be-57c7-43f1-a6f9-02efd9bed5c8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:21.298302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-233152be-57c7-43f1-a6f9-02efd9bed5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:21.333828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d7330-a068-49e4-931f-002eb0ccfd33 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.370614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8672b-5612-48e6-8d50-818f133dd03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.371262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8672b-5612-48e6-8d50-818f133dd03d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.371542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8672b-5612-48e6-8d50-818f133dd03d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.371847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8672b-5612-48e6-8d50-818f133dd03d None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.372565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8672b-5612-48e6-8d50-818f133dd03d None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:21.372866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8672b-5612-48e6-8d50-818f133dd03d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:21.374295 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8672b-5612-48e6-8d50-818f133dd03d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:21.375140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 257/495] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:21.376268 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233152be-57c7-43f1-a6f9-02efd9bed5c8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.383624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 239/496] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:21.384469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8672b-5612-48e6-8d50-818f133dd03d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.389987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:21.488770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233152be-57c7-43f1-a6f9-02efd9bed5c8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.491586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:21.503552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8672b-5612-48e6-8d50-818f133dd03d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.528781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d55af-82d2-47dc-9588-a424765906b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.529457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d55af-82d2-47dc-9588-a424765906b3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.529729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d55af-82d2-47dc-9588-a424765906b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.529998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d55af-82d2-47dc-9588-a424765906b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.530685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d55af-82d2-47dc-9588-a424765906b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:21.531001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d55af-82d2-47dc-9588-a424765906b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:21.532409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d55af-82d2-47dc-9588-a424765906b3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:21.543162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd462b7-0b32-4119-b02b-6423ba117629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.543796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd462b7-0b32-4119-b02b-6423ba117629 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.544067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd462b7-0b32-4119-b02b-6423ba117629 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.544194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 258/497] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:21.544370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd462b7-0b32-4119-b02b-6423ba117629 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.545042 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd462b7-0b32-4119-b02b-6423ba117629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:21.545374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd462b7-0b32-4119-b02b-6423ba117629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:21.545489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2e0a-8d38-4cdd-95be-bf4c02c1aca8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.545684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2e0a-8d38-4cdd-95be-bf4c02c1aca8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.545955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2e0a-8d38-4cdd-95be-bf4c02c1aca8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.546752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd462b7-0b32-4119-b02b-6423ba117629 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:21.549332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 259/498] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:21.549332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2e0a-8d38-4cdd-95be-bf4c02c1aca8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.560596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 240/499] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:21.561506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd462b7-0b32-4119-b02b-6423ba117629 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.624797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:21.655472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2e0a-8d38-4cdd-95be-bf4c02c1aca8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.667764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd462b7-0b32-4119-b02b-6423ba117629 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.691775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180ae22-fdbf-4969-9116-c09f8e64a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.692434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ae22-fdbf-4969-9116-c09f8e64a363 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.692718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ae22-fdbf-4969-9116-c09f8e64a363 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.693073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ae22-fdbf-4969-9116-c09f8e64a363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.705132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180ae22-fdbf-4969-9116-c09f8e64a363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:21.706072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c95b2-b980-4e3f-8336-cc7ce0c58468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.706763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180ae22-fdbf-4969-9116-c09f8e64a363 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:21.706884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c95b2-b980-4e3f-8336-cc7ce0c58468 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.707072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c95b2-b980-4e3f-8336-cc7ce0c58468 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.707471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c95b2-b980-4e3f-8336-cc7ce0c58468 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.718056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c95b2-b980-4e3f-8336-cc7ce0c58468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1180ae22-fdbf-4969-9116-c09f8e64a363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:21.721889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:21.723142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:21.724017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:21.724017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:21.724017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:21.724017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:21.724017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 260/500] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-424c95b2-b980-4e3f-8336-cc7ce0c58468 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:21.724280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:21.725091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:21.725929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:21.726546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180ae22-fdbf-4969-9116-c09f8e64a363 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.726624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 241/501] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:21.726624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9682c-978f-4bf6-aeee-d7c7297d9047 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.726624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9682c-978f-4bf6-aeee-d7c7297d9047 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.726624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9682c-978f-4bf6-aeee-d7c7297d9047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.745004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b9c9682c-978f-4bf6-aeee-d7c7297d9047 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:21.746257 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b9c9682c-978f-4bf6-aeee-d7c7297d9047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:21.747260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:21.812754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 242/502] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:21.813657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9682c-978f-4bf6-aeee-d7c7297d9047 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.842178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180ae22-fdbf-4969-9116-c09f8e64a363 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.871211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:21.879546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f0178-4b1b-407a-92ee-edd83ea0609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.880133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f0178-4b1b-407a-92ee-edd83ea0609a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.880413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f0178-4b1b-407a-92ee-edd83ea0609a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.880688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f0178-4b1b-407a-92ee-edd83ea0609a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.888724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f0178-4b1b-407a-92ee-edd83ea0609a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:21.890244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f0178-4b1b-407a-92ee-edd83ea0609a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-111f0178-4b1b-407a-92ee-edd83ea0609a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:21.903168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:21.904136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:21.905062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 261/503] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:21.905970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f0178-4b1b-407a-92ee-edd83ea0609a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.922336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9682c-978f-4bf6-aeee-d7c7297d9047 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:21.956809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a9595-344f-4f6e-a0a6-8b6686d7a09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:21.957494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a9595-344f-4f6e-a0a6-8b6686d7a09a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:21.957774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a9595-344f-4f6e-a0a6-8b6686d7a09a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:21.958046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a9595-344f-4f6e-a0a6-8b6686d7a09a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:21.965815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a9595-344f-4f6e-a0a6-8b6686d7a09a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:21.967270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a9595-344f-4f6e-a0a6-8b6686d7a09a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9c9a9595-344f-4f6e-a0a6-8b6686d7a09a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:21.980503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:21.981643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 243/504] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:21.987946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a9595-344f-4f6e-a0a6-8b6686d7a09a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:21.988704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:22.012934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f0178-4b1b-407a-92ee-edd83ea0609a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.046402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac07bc9-8617-4c1c-837e-caca3286a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.047091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac07bc9-8617-4c1c-837e-caca3286a507 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.047286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac07bc9-8617-4c1c-837e-caca3286a507 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.047547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac07bc9-8617-4c1c-837e-caca3286a507 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.048234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac07bc9-8617-4c1c-837e-caca3286a507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:22.048539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac07bc9-8617-4c1c-837e-caca3286a507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.049964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac07bc9-8617-4c1c-837e-caca3286a507 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.061769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 262/505] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:22.062600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac07bc9-8617-4c1c-837e-caca3286a507 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:22.094357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a9595-344f-4f6e-a0a6-8b6686d7a09a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.108685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:22.131408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c40c-6061-42f9-bc81-322577125f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.131996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c40c-6061-42f9-bc81-322577125f6a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.132264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c40c-6061-42f9-bc81-322577125f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.132531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c40c-6061-42f9-bc81-322577125f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.133282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047c40c-6061-42f9-bc81-322577125f6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:22.133602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047c40c-6061-42f9-bc81-322577125f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.135046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047c40c-6061-42f9-bc81-322577125f6a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.144088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 244/506] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:22.144982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c40c-6061-42f9-bc81-322577125f6a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:22.173949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac07bc9-8617-4c1c-837e-caca3286a507 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.211165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc71fac-974b-4ad6-b547-6e7714ff0ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.211961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc71fac-974b-4ad6-b547-6e7714ff0ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.212315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc71fac-974b-4ad6-b547-6e7714ff0ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.212592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc71fac-974b-4ad6-b547-6e7714ff0ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.216097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:22.226471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc71fac-974b-4ad6-b547-6e7714ff0ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.228005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc71fac-974b-4ad6-b547-6e7714ff0ee3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8dc71fac-974b-4ad6-b547-6e7714ff0ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:22.244324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:22.245524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:22.246555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:22.246555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:22.246555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:22.246555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:22.246555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 263/507] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:22.246555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc71fac-974b-4ad6-b547-6e7714ff0ee3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:22.257452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c40c-6061-42f9-bc81-322577125f6a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.294162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3ca43-c1d7-475f-8598-f173cc98a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.294816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3ca43-c1d7-475f-8598-f173cc98a063 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.295093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3ca43-c1d7-475f-8598-f173cc98a063 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.295373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3ca43-c1d7-475f-8598-f173cc98a063 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.296208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3ca43-c1d7-475f-8598-f173cc98a063 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:22.296517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3ca43-c1d7-475f-8598-f173cc98a063 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.298053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3ca43-c1d7-475f-8598-f173cc98a063 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.337584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 245/508] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:22.338569 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3ca43-c1d7-475f-8598-f173cc98a063 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:22.359457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc71fac-974b-4ad6-b547-6e7714ff0ee3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.376273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:22.397480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e563b2-8a1d-4166-8b4a-72f909958ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.398001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e563b2-8a1d-4166-8b4a-72f909958ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.398267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e563b2-8a1d-4166-8b4a-72f909958ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.398540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e563b2-8a1d-4166-8b4a-72f909958ec0 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.399363 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e563b2-8a1d-4166-8b4a-72f909958ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:22.399673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e563b2-8a1d-4166-8b4a-72f909958ec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.401191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e563b2-8a1d-4166-8b4a-72f909958ec0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.441241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 264/509] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:22.442172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e563b2-8a1d-4166-8b4a-72f909958ec0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:22.455571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3ca43-c1d7-475f-8598-f173cc98a063 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.489860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540455e8-bd94-4c1d-8c6c-bcc9c3e90504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.490517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540455e8-bd94-4c1d-8c6c-bcc9c3e90504 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.490804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540455e8-bd94-4c1d-8c6c-bcc9c3e90504 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.491073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540455e8-bd94-4c1d-8c6c-bcc9c3e90504 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.493086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:22.498769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540455e8-bd94-4c1d-8c6c-bcc9c3e90504 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.500258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540455e8-bd94-4c1d-8c6c-bcc9c3e90504 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-540455e8-bd94-4c1d-8c6c-bcc9c3e90504 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:22.512561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:22.513715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 246/510] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:22.514805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540455e8-bd94-4c1d-8c6c-bcc9c3e90504 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:22.553668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e563b2-8a1d-4166-8b4a-72f909958ec0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.588115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255df591-90c2-4f88-8aa3-0bd3fe149a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.588766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255df591-90c2-4f88-8aa3-0bd3fe149a96 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.589045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255df591-90c2-4f88-8aa3-0bd3fe149a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.589347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255df591-90c2-4f88-8aa3-0bd3fe149a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.600413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255df591-90c2-4f88-8aa3-0bd3fe149a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.602034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255df591-90c2-4f88-8aa3-0bd3fe149a96 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.610471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-255df591-90c2-4f88-8aa3-0bd3fe149a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:22.617814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:22.618694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:22.619554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:22.619554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:22.619554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:22.619554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:22.619764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540455e8-bd94-4c1d-8c6c-bcc9c3e90504 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.619833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 265/511] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:22.619833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255df591-90c2-4f88-8aa3-0bd3fe149a96 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:22.656806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a2862-05a5-4a7a-8cf9-01a5bbf83e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.657383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2862-05a5-4a7a-8cf9-01a5bbf83e35 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.657665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2862-05a5-4a7a-8cf9-01a5bbf83e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.657934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2862-05a5-4a7a-8cf9-01a5bbf83e35 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.658618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a2862-05a5-4a7a-8cf9-01a5bbf83e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:22.658934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a2862-05a5-4a7a-8cf9-01a5bbf83e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.660379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a2862-05a5-4a7a-8cf9-01a5bbf83e35 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.672806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 247/512] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:22.673504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a2862-05a5-4a7a-8cf9-01a5bbf83e35 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:22.726915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:22.730739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255df591-90c2-4f88-8aa3-0bd3fe149a96 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.766636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fc347-f1e1-48be-9c51-b631a49c89c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.767276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fc347-f1e1-48be-9c51-b631a49c89c1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.767557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fc347-f1e1-48be-9c51-b631a49c89c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.767816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fc347-f1e1-48be-9c51-b631a49c89c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.778307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a2862-05a5-4a7a-8cf9-01a5bbf83e35 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:22.813568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f57d-b153-4968-98b3-88f72f19a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:22.814201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f57d-b153-4968-98b3-88f72f19a476 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:22.814480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f57d-b153-4968-98b3-88f72f19a476 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:22.814762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f57d-b153-4968-98b3-88f72f19a476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:22.837512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fc347-f1e1-48be-9c51-b631a49c89c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.838983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fc347-f1e1-48be-9c51-b631a49c89c1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.840791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:22.885835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64f57d-b153-4968-98b3-88f72f19a476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:22.887311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64f57d-b153-4968-98b3-88f72f19a476 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:22.940778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:22.952492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 266/513] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:22.953482 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fc347-f1e1-48be-9c51-b631a49c89c1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:22.998690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 248/514] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:22.998690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f57d-b153-4968-98b3-88f72f19a476 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:23.052567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:23.056327 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fc347-f1e1-48be-9c51-b631a49c89c1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:23.094159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c318e74-083a-4194-9231-c68f6989ef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:23.094799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c318e74-083a-4194-9231-c68f6989ef27 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:23.095079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c318e74-083a-4194-9231-c68f6989ef27 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:23.095353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c318e74-083a-4194-9231-c68f6989ef27 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:23.096179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c318e74-083a-4194-9231-c68f6989ef27 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:23.096489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c318e74-083a-4194-9231-c68f6989ef27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:23.098013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c318e74-083a-4194-9231-c68f6989ef27 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:23.102499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f57d-b153-4968-98b3-88f72f19a476 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:23.116134 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 267/515] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:23.116978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c318e74-083a-4194-9231-c68f6989ef27 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:23.144670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89aa81-777e-4810-8111-9990abe55641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:23.145387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89aa81-777e-4810-8111-9990abe55641 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:23.145697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89aa81-777e-4810-8111-9990abe55641 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:23.145964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89aa81-777e-4810-8111-9990abe55641 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:23.146680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89aa81-777e-4810-8111-9990abe55641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:23.146996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89aa81-777e-4810-8111-9990abe55641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:23.148388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89aa81-777e-4810-8111-9990abe55641 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:23.161103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 249/516] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:23.162078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89aa81-777e-4810-8111-9990abe55641 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:23.196008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:23.246613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c318e74-083a-4194-9231-c68f6989ef27 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:23.269857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89aa81-777e-4810-8111-9990abe55641 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:23.281525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364c552-e919-4239-aaa9-051a17c7ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:23.282154 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364c552-e919-4239-aaa9-051a17c7ef3a None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:23.282429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364c552-e919-4239-aaa9-051a17c7ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:23.282697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364c552-e919-4239-aaa9-051a17c7ef3a None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:23.283382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364c552-e919-4239-aaa9-051a17c7ef3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:23.283955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:23.284869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364c552-e919-4239-aaa9-051a17c7ef3a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:23.305134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2ebb8-ddf3-4a70-8954-aa574de813c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:23.305811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2ebb8-ddf3-4a70-8954-aa574de813c6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:23.306093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2ebb8-ddf3-4a70-8954-aa574de813c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:23.306220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 268/517] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:14:23 2022] POST /identity/v3/users => generated 247 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:14:23.306381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2ebb8-ddf3-4a70-8954-aa574de813c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:23.306962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364c552-e919-4239-aaa9-051a17c7ef3a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:23.319741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2ebb8-ddf3-4a70-8954-aa574de813c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:23.321621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2ebb8-ddf3-4a70-8954-aa574de813c6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d5b2ebb8-ddf3-4a70-8954-aa574de813c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:23.346380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:23.347400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:23.348309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:23.348309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:23.348309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:23.348309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:23.348309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 250/518] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:23.348609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2ebb8-ddf3-4a70-8954-aa574de813c6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:23.485397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364c552-e919-4239-aaa9-051a17c7ef3a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:23.504853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2ebb8-ddf3-4a70-8954-aa574de813c6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:23.506310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:23.542760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421b6c2-bc7f-4311-ad08-17212cffe4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:23.543810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421b6c2-bc7f-4311-ad08-17212cffe4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:23.544364 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421b6c2-bc7f-4311-ad08-17212cffe4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:23.544732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421b6c2-bc7f-4311-ad08-17212cffe4e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:23.547461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29ef35-e879-451c-bfe1-388f601e810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:23.548593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29ef35-e879-451c-bfe1-388f601e810d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:23.549046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29ef35-e879-451c-bfe1-388f601e810d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:23.549860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29ef35-e879-451c-bfe1-388f601e810d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:23.563042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421b6c2-bc7f-4311-ad08-17212cffe4e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:23.564741 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421b6c2-bc7f-4311-ad08-17212cffe4e5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9421b6c2-bc7f-4311-ad08-17212cffe4e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:23.580406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:23.582584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:23.584413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:23.584413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:23.584413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:23.584413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:23.584413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 269/519] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:23.584413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421b6c2-bc7f-4311-ad08-17212cffe4e5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:23.610070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:23.657030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29ef35-e879-451c-bfe1-388f601e810d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:23.658958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29ef35-e879-451c-bfe1-388f601e810d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:23.700394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421b6c2-bc7f-4311-ad08-17212cffe4e5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:23.747124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36eb67-d197-4079-8a48-35e34f28dce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:23.748491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36eb67-d197-4079-8a48-35e34f28dce7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:23.748491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36eb67-d197-4079-8a48-35e34f28dce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:23.748491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36eb67-d197-4079-8a48-35e34f28dce7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:23.759270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36eb67-d197-4079-8a48-35e34f28dce7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:23.760899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36eb67-d197-4079-8a48-35e34f28dce7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ca36eb67-d197-4079-8a48-35e34f28dce7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:23.775159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:23.776372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 270/520] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:23.784372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36eb67-d197-4079-8a48-35e34f28dce7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:23.798818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 251/521] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:23.804122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29ef35-e879-451c-bfe1-388f601e810d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:23.821751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:23.917885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:23.935714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36eb67-d197-4079-8a48-35e34f28dce7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:23.975876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3050c8-f838-487c-bde4-20c919c1d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:23.976510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3050c8-f838-487c-bde4-20c919c1d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:23.976778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3050c8-f838-487c-bde4-20c919c1d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:23.977042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3050c8-f838-487c-bde4-20c919c1d6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:23.977785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3050c8-f838-487c-bde4-20c919c1d6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:23.978081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3050c8-f838-487c-bde4-20c919c1d6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:23.978190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29ef35-e879-451c-bfe1-388f601e810d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:23.979467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3050c8-f838-487c-bde4-20c919c1d6e1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:23.993752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 271/522] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:23.999307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3050c8-f838-487c-bde4-20c919c1d6e1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:24.028565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40db7ac-f327-45d4-8440-5c6ebdd5adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:24.029324 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40db7ac-f327-45d4-8440-5c6ebdd5adb1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:24.029713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40db7ac-f327-45d4-8440-5c6ebdd5adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:24.030205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40db7ac-f327-45d4-8440-5c6ebdd5adb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:24.031232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40db7ac-f327-45d4-8440-5c6ebdd5adb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:24.031619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40db7ac-f327-45d4-8440-5c6ebdd5adb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:24.033397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40db7ac-f327-45d4-8440-5c6ebdd5adb1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:24.054002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 252/523] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:24.054002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40db7ac-f327-45d4-8440-5c6ebdd5adb1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:24.110471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:24.137312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3050c8-f838-487c-bde4-20c919c1d6e1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:24.187607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40db7ac-f327-45d4-8440-5c6ebdd5adb1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:24.192623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b51fd-b359-40b0-8031-67d3a2ff9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:24.193710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b51fd-b359-40b0-8031-67d3a2ff9806 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:24.194176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b51fd-b359-40b0-8031-67d3a2ff9806 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:24.194628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b51fd-b359-40b0-8031-67d3a2ff9806 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:24.195931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b51fd-b359-40b0-8031-67d3a2ff9806 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:24.196277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b51fd-b359-40b0-8031-67d3a2ff9806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:24.197937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b51fd-b359-40b0-8031-67d3a2ff9806 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:24.231424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 272/524] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jul 26 07:14:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:24.231424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b51fd-b359-40b0-8031-67d3a2ff9806 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:24.232359 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:24.245856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd36968-ca6a-4afe-ae16-a088b1dbfceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:24.246535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd36968-ca6a-4afe-ae16-a088b1dbfceb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:24.246814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd36968-ca6a-4afe-ae16-a088b1dbfceb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:24.247086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd36968-ca6a-4afe-ae16-a088b1dbfceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:24.259407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd36968-ca6a-4afe-ae16-a088b1dbfceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:24.260818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd36968-ca6a-4afe-ae16-a088b1dbfceb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-fcd36968-ca6a-4afe-ae16-a088b1dbfceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:24.277108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:24.278080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:24.279045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:24.279045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:24.279045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:24.279045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:24.279045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 253/525] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:24.279415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd36968-ca6a-4afe-ae16-a088b1dbfceb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:24.365029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b51fd-b359-40b0-8031-67d3a2ff9806 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:24.419544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf07e14-816b-4866-9ae9-1a0fafc75eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:24.420585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07e14-816b-4866-9ae9-1a0fafc75eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:24.421052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07e14-816b-4866-9ae9-1a0fafc75eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:24.421556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07e14-816b-4866-9ae9-1a0fafc75eb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:24.427782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd36968-ca6a-4afe-ae16-a088b1dbfceb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:24.432584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf07e14-816b-4866-9ae9-1a0fafc75eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:24.435142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf07e14-816b-4866-9ae9-1a0fafc75eb2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2cf07e14-816b-4866-9ae9-1a0fafc75eb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:24.455330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:24.457203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:24.458894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:24.458894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:24.458894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:24.458894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:24.458894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:24.458894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:24.458894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:24.458894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:24.463886 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 273/526] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:24.464388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf07e14-816b-4866-9ae9-1a0fafc75eb2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:24.468033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:24.483506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3937d-d3fb-4a8d-bb00-fed055f35f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:24.484162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3937d-d3fb-4a8d-bb00-fed055f35f79 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:24.484445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3937d-d3fb-4a8d-bb00-fed055f35f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:24.484773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3937d-d3fb-4a8d-bb00-fed055f35f79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:24.492027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3937d-d3fb-4a8d-bb00-fed055f35f79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:24.493534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3937d-d3fb-4a8d-bb00-fed055f35f79 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-74f3937d-d3fb-4a8d-bb00-fed055f35f79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:24.506354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:24.507330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:24.508199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:24.508199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:24.508199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:24.508199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:24.508199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:24.508199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:24.508199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:24.508199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:24.512721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 254/527] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:24.513307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3937d-d3fb-4a8d-bb00-fed055f35f79 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:24.568015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:24.601660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf07e14-816b-4866-9ae9-1a0fafc75eb2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:24.638100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138d3b-77a2-4749-947c-1da2d5512db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:24.638772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138d3b-77a2-4749-947c-1da2d5512db5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:24.639072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138d3b-77a2-4749-947c-1da2d5512db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:24.639286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138d3b-77a2-4749-947c-1da2d5512db5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:24.644729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3937d-d3fb-4a8d-bb00-fed055f35f79 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:24.690419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8265c-d463-448b-84c6-2060771d7c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:24.691167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8265c-d463-448b-84c6-2060771d7c62 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:24.691444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8265c-d463-448b-84c6-2060771d7c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:24.691710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8265c-d463-448b-84c6-2060771d7c62 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:24.692410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8265c-d463-448b-84c6-2060771d7c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:24.696121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8265c-d463-448b-84c6-2060771d7c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:24.696121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8265c-d463-448b-84c6-2060771d7c62 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:24.715392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 255/528] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:24.715392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8265c-d463-448b-84c6-2060771d7c62 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:24.743501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138d3b-77a2-4749-947c-1da2d5512db5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:24.746049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138d3b-77a2-4749-947c-1da2d5512db5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:24.749747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:24.834681 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:24.839701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8265c-d463-448b-84c6-2060771d7c62 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:24.880617 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 274/529] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:24.881569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138d3b-77a2-4749-947c-1da2d5512db5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:24.898789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62006d-ed5a-4829-9066-560eeacc859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:24.899730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62006d-ed5a-4829-9066-560eeacc859d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:24.899945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62006d-ed5a-4829-9066-560eeacc859d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:24.900223 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62006d-ed5a-4829-9066-560eeacc859d None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:24.901097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62006d-ed5a-4829-9066-560eeacc859d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:24.901425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62006d-ed5a-4829-9066-560eeacc859d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:24.903860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62006d-ed5a-4829-9066-560eeacc859d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:24.929300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 256/530] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:24.929300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62006d-ed5a-4829-9066-560eeacc859d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:25.024904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138d3b-77a2-4749-947c-1da2d5512db5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:25.027026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:25.074953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60ef8-aa8c-4c14-b3cd-39b54c813026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:25.075707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60ef8-aa8c-4c14-b3cd-39b54c813026 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.076022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60ef8-aa8c-4c14-b3cd-39b54c813026 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.076395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60ef8-aa8c-4c14-b3cd-39b54c813026 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.077408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f60ef8-aa8c-4c14-b3cd-39b54c813026 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:25.077795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f60ef8-aa8c-4c14-b3cd-39b54c813026 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:25.079876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f60ef8-aa8c-4c14-b3cd-39b54c813026 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:25.080242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62006d-ed5a-4829-9066-560eeacc859d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:25.112092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 275/531] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:25.112092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60ef8-aa8c-4c14-b3cd-39b54c813026 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:25.130399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec195-d44d-4785-9275-24758f7e3f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:25.131646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec195-d44d-4785-9275-24758f7e3f07 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.132133 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec195-d44d-4785-9275-24758f7e3f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.132612 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec195-d44d-4785-9275-24758f7e3f07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.143109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ec195-d44d-4785-9275-24758f7e3f07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:25.145305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ec195-d44d-4785-9275-24758f7e3f07 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e53ec195-d44d-4785-9275-24758f7e3f07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:25.158734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:25.160170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 257/532] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:25.161453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec195-d44d-4785-9275-24758f7e3f07 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:25.189988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:25.235713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60ef8-aa8c-4c14-b3cd-39b54c813026 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:25.284141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362ecd0-be56-4364-8ed1-6ee4c8dc222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:25.284936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362ecd0-be56-4364-8ed1-6ee4c8dc222a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.285310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362ecd0-be56-4364-8ed1-6ee4c8dc222a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.285658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362ecd0-be56-4364-8ed1-6ee4c8dc222a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.298823 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362ecd0-be56-4364-8ed1-6ee4c8dc222a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:25.301825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362ecd0-be56-4364-8ed1-6ee4c8dc222a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:25.312898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec195-d44d-4785-9275-24758f7e3f07 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e362ecd0-be56-4364-8ed1-6ee4c8dc222a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:25.327348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:25.328508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:25.329528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:25.329528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:25.329528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:25.329528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:25.329528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 276/533] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:25.330360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362ecd0-be56-4364-8ed1-6ee4c8dc222a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:25.352010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:25.371556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9af75-6eaf-4fb2-b1a3-08ca67961a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:25.372485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9af75-6eaf-4fb2-b1a3-08ca67961a60 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.372966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9af75-6eaf-4fb2-b1a3-08ca67961a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.373493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9af75-6eaf-4fb2-b1a3-08ca67961a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.374987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9af75-6eaf-4fb2-b1a3-08ca67961a60 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=c70a0ca34a3940d1b067430c9c2dc64e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:25.375516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9af75-6eaf-4fb2-b1a3-08ca67961a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:25.378101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9af75-6eaf-4fb2-b1a3-08ca67961a60 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:25.393315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 258/534] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:25 2022] GET /identity/v3/role_assignments?user.id=c70a0ca34a3940d1b067430c9c2dc64e&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:25.393315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9af75-6eaf-4fb2-b1a3-08ca67961a60 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:25.485177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362ecd0-be56-4364-8ed1-6ee4c8dc222a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:25.520288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:25.537939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c2cba-b5fd-4a38-a485-c535f29a8275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:25.539023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c2cba-b5fd-4a38-a485-c535f29a8275 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.539328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c2cba-b5fd-4a38-a485-c535f29a8275 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.539591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c2cba-b5fd-4a38-a485-c535f29a8275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.540607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c2cba-b5fd-4a38-a485-c535f29a8275 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=2ecb8054ea4249d18903b5998fa753d6) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:25.540921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c2cba-b5fd-4a38-a485-c535f29a8275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:25.542491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c2cba-b5fd-4a38-a485-c535f29a8275 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:25.546628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9af75-6eaf-4fb2-b1a3-08ca67961a60 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:25.549142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 277/535] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:25 2022] GET /identity/v3/role_assignments?user.id=2ecb8054ea4249d18903b5998fa753d6&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:25.558410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c2cba-b5fd-4a38-a485-c535f29a8275 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:25.596237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1cb01-b7a5-4470-9775-81d1e7899b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:25.596909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1cb01-b7a5-4470-9775-81d1e7899b16 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.597304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1cb01-b7a5-4470-9775-81d1e7899b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.597589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1cb01-b7a5-4470-9775-81d1e7899b16 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.598424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1cb01-b7a5-4470-9775-81d1e7899b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:25.598733 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1cb01-b7a5-4470-9775-81d1e7899b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:25.600451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1cb01-b7a5-4470-9775-81d1e7899b16 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:25.622825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 259/536] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:25.624261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb80f-2165-44ba-8f3b-52b77e80d306 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.624547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb80f-2165-44ba-8f3b-52b77e80d306 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.624822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb80f-2165-44ba-8f3b-52b77e80d306 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.630627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 260/537] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:25.630627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb80f-2165-44ba-8f3b-52b77e80d306 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:25.712015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:25.741516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c2cba-b5fd-4a38-a485-c535f29a8275 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:25.777824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb80f-2165-44ba-8f3b-52b77e80d306 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:25.786413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8eac9-4d80-4fb0-b41c-6b03ef764443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:25.787455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8eac9-4d80-4fb0-b41c-6b03ef764443 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.787740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8eac9-4d80-4fb0-b41c-6b03ef764443 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.788132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8eac9-4d80-4fb0-b41c-6b03ef764443 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.789052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8eac9-4d80-4fb0-b41c-6b03ef764443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:25.790122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8eac9-4d80-4fb0-b41c-6b03ef764443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:25.791422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8eac9-4d80-4fb0-b41c-6b03ef764443 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:25.809433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 278/538] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:25.811018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d3da-48af-412b-9b02-7170b109e6fe None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.811303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d3da-48af-412b-9b02-7170b109e6fe None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.811599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d3da-48af-412b-9b02-7170b109e6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.828154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdf712-c326-43e8-97f9-7b237e86efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:25.828868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdf712-c326-43e8-97f9-7b237e86efa5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:25.829137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdf712-c326-43e8-97f9-7b237e86efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:25.829428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdf712-c326-43e8-97f9-7b237e86efa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:25.830830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdf712-c326-43e8-97f9-7b237e86efa5 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=59f6195586c7434ab85604181ec2a076) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:25.831402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdf712-c326-43e8-97f9-7b237e86efa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:25.833398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdf712-c326-43e8-97f9-7b237e86efa5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:25.834443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5551d3da-48af-412b-9b02-7170b109e6fe None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:25.836419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5551d3da-48af-412b-9b02-7170b109e6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:25.845670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 261/539] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:25 2022] GET /identity/v3/role_assignments?user.id=59f6195586c7434ab85604181ec2a076&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:25.846801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdf712-c326-43e8-97f9-7b237e86efa5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:25.861452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:25.930022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 279/540] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:25.957878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551d3da-48af-412b-9b02-7170b109e6fe None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:26.045410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:26.113018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551d3da-48af-412b-9b02-7170b109e6fe None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:26.140562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdf712-c326-43e8-97f9-7b237e86efa5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:26.169932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2808da-e941-4407-81c8-17749e0571d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:26.170624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2808da-e941-4407-81c8-17749e0571d8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:26.170899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2808da-e941-4407-81c8-17749e0571d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:26.171177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2808da-e941-4407-81c8-17749e0571d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:26.198767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db1819-a7c1-4c8f-baf8-e9daad4b1a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:26.199476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db1819-a7c1-4c8f-baf8-e9daad4b1a6e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:26.199719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db1819-a7c1-4c8f-baf8-e9daad4b1a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:26.200025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db1819-a7c1-4c8f-baf8-e9daad4b1a6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:26.202408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2808da-e941-4407-81c8-17749e0571d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-bc2808da-e941-4407-81c8-17749e0571d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:26.208295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:26.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:26.210216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:26.210885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db1819-a7c1-4c8f-baf8-e9daad4b1a6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:26.211477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db1819-a7c1-4c8f-baf8-e9daad4b1a6e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:26.216903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 280/541] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:26.217988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2808da-e941-4407-81c8-17749e0571d8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-38db1819-a7c1-4c8f-baf8-e9daad4b1a6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:26.225763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:26.227860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:26.230088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:26.230088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:26.230088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:26.230088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:26.230088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:26.230088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:26.230088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:26.230088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:26.230088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 262/542] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:26.235684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db1819-a7c1-4c8f-baf8-e9daad4b1a6e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:26.326879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:26.419159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2808da-e941-4407-81c8-17749e0571d8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:26.421637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db1819-a7c1-4c8f-baf8-e9daad4b1a6e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:26.454769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:26.464464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575bfae-a39f-4b94-aded-2d2af890b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:26.465110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575bfae-a39f-4b94-aded-2d2af890b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:26.465449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575bfae-a39f-4b94-aded-2d2af890b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:26.465723 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575bfae-a39f-4b94-aded-2d2af890b2a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:26.466464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575bfae-a39f-4b94-aded-2d2af890b2a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:26.466772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575bfae-a39f-4b94-aded-2d2af890b2a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:26.474922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575bfae-a39f-4b94-aded-2d2af890b2a4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:26.486117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c04721-865c-4e81-bea4-3c462bdd5362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:26.487134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04721-865c-4e81-bea4-3c462bdd5362 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:26.488688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04721-865c-4e81-bea4-3c462bdd5362 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:26.489192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04721-865c-4e81-bea4-3c462bdd5362 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:26.490227 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c04721-865c-4e81-bea4-3c462bdd5362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:26.490946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c04721-865c-4e81-bea4-3c462bdd5362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:26.493093 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 281/543] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:26.494890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c04721-865c-4e81-bea4-3c462bdd5362 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:26.499997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575bfae-a39f-4b94-aded-2d2af890b2a4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:26.520489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 263/544] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:26.526217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c04721-865c-4e81-bea4-3c462bdd5362 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:26.654868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575bfae-a39f-4b94-aded-2d2af890b2a4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:26.698565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c04721-865c-4e81-bea4-3c462bdd5362 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:26.736083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:26.740711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe83fec-4564-403b-bf36-e9817a6ff17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:26.741799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe83fec-4564-403b-bf36-e9817a6ff17f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:26.742332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe83fec-4564-403b-bf36-e9817a6ff17f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:26.745083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fa43b-3bda-41b2-896c-8dc5554ff799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:26.745365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe83fec-4564-403b-bf36-e9817a6ff17f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:26.745923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa43b-3bda-41b2-896c-8dc5554ff799 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:26.749282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa43b-3bda-41b2-896c-8dc5554ff799 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:26.749282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa43b-3bda-41b2-896c-8dc5554ff799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:26.749282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fa43b-3bda-41b2-896c-8dc5554ff799 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=7eab2497edff4c968030b5b0d6814150) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:26.749282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fa43b-3bda-41b2-896c-8dc5554ff799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:26.749952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fa43b-3bda-41b2-896c-8dc5554ff799 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:26.756599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 264/545] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:26 2022] GET /identity/v3/role_assignments?user.id=7eab2497edff4c968030b5b0d6814150&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:26.787877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe83fec-4564-403b-bf36-e9817a6ff17f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:26.789451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe83fec-4564-403b-bf36-e9817a6ff17f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-afe83fec-4564-403b-bf36-e9817a6ff17f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:26.822179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:26.823135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:26.823997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:26.823997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:26.823997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:26.823997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:26.823997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 282/546] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:26.829417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fa43b-3bda-41b2-896c-8dc5554ff799 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:26.974525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fa43b-3bda-41b2-896c-8dc5554ff799 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:27.022959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b84c8b-85f2-4f17-9942-493a3584d6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:27.023499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84c8b-85f2-4f17-9942-493a3584d6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:27.023779 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84c8b-85f2-4f17-9942-493a3584d6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:27.024049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84c8b-85f2-4f17-9942-493a3584d6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:27.024744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b84c8b-85f2-4f17-9942-493a3584d6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:27.025047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b84c8b-85f2-4f17-9942-493a3584d6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:27.026471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b84c8b-85f2-4f17-9942-493a3584d6b0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:27.041327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 265/547] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:27.046830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe83fec-4564-403b-bf36-e9817a6ff17f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:27.129066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:27.201030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe83fec-4564-403b-bf36-e9817a6ff17f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:27.247978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e439477-ee20-40b3-a309-0d40285a8b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:27.248643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e439477-ee20-40b3-a309-0d40285a8b79 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:27.248916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e439477-ee20-40b3-a309-0d40285a8b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:27.249184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e439477-ee20-40b3-a309-0d40285a8b79 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:27.262588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e439477-ee20-40b3-a309-0d40285a8b79 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:27.264054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e439477-ee20-40b3-a309-0d40285a8b79 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2e439477-ee20-40b3-a309-0d40285a8b79 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:27.278920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:27.280322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:27.281572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 283/548] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:27.286312 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b84c8b-85f2-4f17-9942-493a3584d6b0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:27.365725 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:27.433043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b84c8b-85f2-4f17-9942-493a3584d6b0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:27.481897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f543e-f822-4c67-a2e3-5fc4678faeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:27.482560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f543e-f822-4c67-a2e3-5fc4678faeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:27.482838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f543e-f822-4c67-a2e3-5fc4678faeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:27.483113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f543e-f822-4c67-a2e3-5fc4678faeb0 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:27.483977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f543e-f822-4c67-a2e3-5fc4678faeb0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:27.484287 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f543e-f822-4c67-a2e3-5fc4678faeb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:27.485860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f543e-f822-4c67-a2e3-5fc4678faeb0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:27.514436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 266/549] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 26 07:14:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:27.519875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e439477-ee20-40b3-a309-0d40285a8b79 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:27.720838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e439477-ee20-40b3-a309-0d40285a8b79 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:27.722548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:27.757581 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475422b-6503-4688-a349-d7cb4f42696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:27.758215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475422b-6503-4688-a349-d7cb4f42696e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:27.758494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475422b-6503-4688-a349-d7cb4f42696e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:27.758767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475422b-6503-4688-a349-d7cb4f42696e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:27.832544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475422b-6503-4688-a349-d7cb4f42696e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:27.834127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475422b-6503-4688-a349-d7cb4f42696e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:27.948589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cfb50-1d35-40f5-8242-be1584633bd6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:27.949317 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cfb50-1d35-40f5-8242-be1584633bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:27.950171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cfb50-1d35-40f5-8242-be1584633bd6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:27.953061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 267/550] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:27.957968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4d36-4f14-434a-967b-1b65742dc25f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:27.958651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4d36-4f14-434a-967b-1b65742dc25f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:27.959133 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4d36-4f14-434a-967b-1b65742dc25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:27.973044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 284/551] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:27.978590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475422b-6503-4688-a349-d7cb4f42696e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:27.980808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:27.985964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0c3e4d36-4f14-434a-967b-1b65742dc25f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:27.987512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0c3e4d36-4f14-434a-967b-1b65742dc25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:28.085202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 268/552] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:28.085202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c714f-7d43-4991-86cf-076c4186a7d7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.085202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c714f-7d43-4991-86cf-076c4186a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.085202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c714f-7d43-4991-86cf-076c4186a7d7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.085202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 269/553] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:28.090358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55e5a-6121-4444-8661-0a58d6df0269 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.090647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55e5a-6121-4444-8661-0a58d6df0269 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.090927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55e5a-6121-4444-8661-0a58d6df0269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.119148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bfc55e5a-6121-4444-8661-0a58d6df0269 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:28.120425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bfc55e5a-6121-4444-8661-0a58d6df0269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:28.131245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475422b-6503-4688-a349-d7cb4f42696e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:28.153421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:28.172475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12697d-289e-4bc0-9654-f84a87552db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:28.173705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12697d-289e-4bc0-9654-f84a87552db2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.174293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12697d-289e-4bc0-9654-f84a87552db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.174787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12697d-289e-4bc0-9654-f84a87552db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.187742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12697d-289e-4bc0-9654-f84a87552db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:28.189674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12697d-289e-4bc0-9654-f84a87552db2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:28.196089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 270/554] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:28.196972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc55e5a-6121-4444-8661-0a58d6df0269 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6e12697d-289e-4bc0-9654-f84a87552db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:28.207282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:28.208199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:28.209090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:28.209090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:28.209090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:28.209090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:28.211538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 285/555] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:28.219869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12697d-289e-4bc0-9654-f84a87552db2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:28.287246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:28.318637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc55e5a-6121-4444-8661-0a58d6df0269 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:28.343872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12697d-289e-4bc0-9654-f84a87552db2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:28.356585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6954e7-c059-446a-89e0-869f8e68d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:28.357269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6954e7-c059-446a-89e0-869f8e68d049 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.357556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6954e7-c059-446a-89e0-869f8e68d049 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.357829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6954e7-c059-446a-89e0-869f8e68d049 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.369682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6954e7-c059-446a-89e0-869f8e68d049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4f6954e7-c059-446a-89e0-869f8e68d049 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:28.375056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:28.376235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 271/556] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:28.377127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6954e7-c059-446a-89e0-869f8e68d049 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:28.386746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ffb4-7965-4f4b-982b-c8375a80d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:28.387599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ffb4-7965-4f4b-982b-c8375a80d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.387943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ffb4-7965-4f4b-982b-c8375a80d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.388277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ffb4-7965-4f4b-982b-c8375a80d9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.389059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ffb4-7965-4f4b-982b-c8375a80d9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:28.389480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ffb4-7965-4f4b-982b-c8375a80d9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:28.391052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ffb4-7965-4f4b-982b-c8375a80d9b0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:28.404968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 286/557] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:28.406164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ffb4-7965-4f4b-982b-c8375a80d9b0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:28.409298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:28.492350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6954e7-c059-446a-89e0-869f8e68d049 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:28.529458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de66f-1a3c-4536-aaa9-050b9c3f5c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:28.530121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de66f-1a3c-4536-aaa9-050b9c3f5c32 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.530398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de66f-1a3c-4536-aaa9-050b9c3f5c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.530671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de66f-1a3c-4536-aaa9-050b9c3f5c32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.538462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ffb4-7965-4f4b-982b-c8375a80d9b0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:28.545546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522de66f-1a3c-4536-aaa9-050b9c3f5c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-522de66f-1a3c-4536-aaa9-050b9c3f5c32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:28.551226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:28.552737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:28.553722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:28.554391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 272/558] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:28.555492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de66f-1a3c-4536-aaa9-050b9c3f5c32 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:28.557387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:28.581203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a420c-9073-422b-aaae-720794a5d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:28.581893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a420c-9073-422b-aaae-720794a5d2fd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.582172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a420c-9073-422b-aaae-720794a5d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.582442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a420c-9073-422b-aaae-720794a5d2fd None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.583192 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a420c-9073-422b-aaae-720794a5d2fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:28.583491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a420c-9073-422b-aaae-720794a5d2fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:28.584873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a420c-9073-422b-aaae-720794a5d2fd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:28.592963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 287/559] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:28.594627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19833d30-e46f-48e2-ad7f-d3b57e98348c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.594912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19833d30-e46f-48e2-ad7f-d3b57e98348c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.595185 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19833d30-e46f-48e2-ad7f-d3b57e98348c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.600394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 288/560] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:28.600394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19833d30-e46f-48e2-ad7f-d3b57e98348c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:28.669717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:28.685233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de66f-1a3c-4536-aaa9-050b9c3f5c32 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:28.719865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19833d30-e46f-48e2-ad7f-d3b57e98348c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:28.734625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b3298-7251-4ef6-9452-096b0a208d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:28.735300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b3298-7251-4ef6-9452-096b0a208d87 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.735744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b3298-7251-4ef6-9452-096b0a208d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.736017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b3298-7251-4ef6-9452-096b0a208d87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.744914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b3298-7251-4ef6-9452-096b0a208d87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:28.746866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b3298-7251-4ef6-9452-096b0a208d87 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:28.759237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476bbe3-5b38-45aa-8637-c30870c5fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:28.759888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476bbe3-5b38-45aa-8637-c30870c5fea0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.760168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476bbe3-5b38-45aa-8637-c30870c5fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.760440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476bbe3-5b38-45aa-8637-c30870c5fea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-404b3298-7251-4ef6-9452-096b0a208d87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:28.760594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:28.761566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:28.762499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:28.762499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:28.762499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:28.762499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:28.762499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:28.762499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:28.762499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:28.762499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:28.763484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476bbe3-5b38-45aa-8637-c30870c5fea0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:28.763484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476bbe3-5b38-45aa-8637-c30870c5fea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:28.763484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476bbe3-5b38-45aa-8637-c30870c5fea0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:28.767107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 273/561] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:28.767930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b3298-7251-4ef6-9452-096b0a208d87 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:28.774689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 289/562] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:28.776485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdce96-99e7-4545-b69b-64e43929476c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.776998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdce96-99e7-4545-b69b-64e43929476c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.778260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdce96-99e7-4545-b69b-64e43929476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.798816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-60bdce96-99e7-4545-b69b-64e43929476c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:28.800115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-60bdce96-99e7-4545-b69b-64e43929476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:28.836711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:28.879769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 290/563] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:28.880884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdce96-99e7-4545-b69b-64e43929476c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:28.899715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b3298-7251-4ef6-9452-096b0a208d87 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:28.940181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3e984-2a8d-42fc-bdac-fa27d99cf956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:28.941007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3e984-2a8d-42fc-bdac-fa27d99cf956 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:28.941286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3e984-2a8d-42fc-bdac-fa27d99cf956 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:28.941489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3e984-2a8d-42fc-bdac-fa27d99cf956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:28.958191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3e984-2a8d-42fc-bdac-fa27d99cf956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:28.959681 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3e984-2a8d-42fc-bdac-fa27d99cf956 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:28.970209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-edb3e984-2a8d-42fc-bdac-fa27d99cf956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:28.978730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:28.979705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:28.980613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:28.980613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:28.980613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:28.980613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:28.980613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 274/564] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:28.980891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3e984-2a8d-42fc-bdac-fa27d99cf956 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.021249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdce96-99e7-4545-b69b-64e43929476c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.078997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83bb2a-7a1f-472e-92e2-fc84623f9ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83bb2a-7a1f-472e-92e2-fc84623f9ebe None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.079942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83bb2a-7a1f-472e-92e2-fc84623f9ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.080217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83bb2a-7a1f-472e-92e2-fc84623f9ebe None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.081005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83bb2a-7a1f-472e-92e2-fc84623f9ebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:29.081526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83bb2a-7a1f-472e-92e2-fc84623f9ebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:29.082998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83bb2a-7a1f-472e-92e2-fc84623f9ebe None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:29.103877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 291/565] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:29.104841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83bb2a-7a1f-472e-92e2-fc84623f9ebe None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.127896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3e984-2a8d-42fc-bdac-fa27d99cf956 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.147059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:29.180310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cfdbb-a6e5-4a30-bf14-12394c84526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.182089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cfdbb-a6e5-4a30-bf14-12394c84526e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.182089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cfdbb-a6e5-4a30-bf14-12394c84526e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.182089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cfdbb-a6e5-4a30-bf14-12394c84526e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.197337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cfdbb-a6e5-4a30-bf14-12394c84526e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:29.198810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cfdbb-a6e5-4a30-bf14-12394c84526e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0f8cfdbb-a6e5-4a30-bf14-12394c84526e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:29.213799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:29.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:29.215637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:29.215637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:29.215637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:29.215637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:29.215637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 275/566] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:29.216373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cfdbb-a6e5-4a30-bf14-12394c84526e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.238195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83bb2a-7a1f-472e-92e2-fc84623f9ebe None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.276761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:29.279248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718127a-5231-484f-b147-a8f0df33ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.279993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718127a-5231-484f-b147-a8f0df33ba6a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.280365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718127a-5231-484f-b147-a8f0df33ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.280678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718127a-5231-484f-b147-a8f0df33ba6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.292936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718127a-5231-484f-b147-a8f0df33ba6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9718127a-5231-484f-b147-a8f0df33ba6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:29.298493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:29.299645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 292/567] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:29.300769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718127a-5231-484f-b147-a8f0df33ba6a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.329069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cfdbb-a6e5-4a30-bf14-12394c84526e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.363969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba7370-4afe-4f96-a9b9-58197128d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.364616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba7370-4afe-4f96-a9b9-58197128d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.364932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba7370-4afe-4f96-a9b9-58197128d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.365239 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba7370-4afe-4f96-a9b9-58197128d3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.365993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba7370-4afe-4f96-a9b9-58197128d3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:29.366329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba7370-4afe-4f96-a9b9-58197128d3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:29.367745 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba7370-4afe-4f96-a9b9-58197128d3b2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:29.380152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 276/568] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:29.381385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadeb2-514b-463b-973b-1cc9b5faeb43 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.381706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadeb2-514b-463b-973b-1cc9b5faeb43 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.382014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadeb2-514b-463b-973b-1cc9b5faeb43 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.386812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 277/569] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:29.386812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dadeb2-514b-463b-973b-1cc9b5faeb43 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.401149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:29.414228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718127a-5231-484f-b147-a8f0df33ba6a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.450602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6fe2d-bd63-4d4d-acd8-fe9840ddd2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.451208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6fe2d-bd63-4d4d-acd8-fe9840ddd2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.451496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6fe2d-bd63-4d4d-acd8-fe9840ddd2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.451759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6fe2d-bd63-4d4d-acd8-fe9840ddd2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.452547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6fe2d-bd63-4d4d-acd8-fe9840ddd2a3 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=b5a03e5f2dee4bdeac26236d8127588c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:29.452849 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6fe2d-bd63-4d4d-acd8-fe9840ddd2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:29.454324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6fe2d-bd63-4d4d-acd8-fe9840ddd2a3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:29.460162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 293/570] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/role_assignments?user.id=b5a03e5f2dee4bdeac26236d8127588c&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:29.460838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6fe2d-bd63-4d4d-acd8-fe9840ddd2a3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.507313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dadeb2-514b-463b-973b-1cc9b5faeb43 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.527808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:29.554911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9d276-64c1-4456-bdf2-645f36c41f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.555561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9d276-64c1-4456-bdf2-645f36c41f6a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.555836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9d276-64c1-4456-bdf2-645f36c41f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.556102 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9d276-64c1-4456-bdf2-645f36c41f6a None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.556811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9d276-64c1-4456-bdf2-645f36c41f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:29.557110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9d276-64c1-4456-bdf2-645f36c41f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:29.558674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9d276-64c1-4456-bdf2-645f36c41f6a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:29.577165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 278/571] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:29.577165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9d276-64c1-4456-bdf2-645f36c41f6a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.592203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6fe2d-bd63-4d4d-acd8-fe9840ddd2a3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.632016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fa932-51ce-4646-b01a-15a92996aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.632665 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fa932-51ce-4646-b01a-15a92996aee0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.632948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fa932-51ce-4646-b01a-15a92996aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.633224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fa932-51ce-4646-b01a-15a92996aee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.633990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fa932-51ce-4646-b01a-15a92996aee0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:29.634596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fa932-51ce-4646-b01a-15a92996aee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:29.635899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fa932-51ce-4646-b01a-15a92996aee0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:29.645885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 294/572] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:29.647119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dab989-ca9d-470b-a917-be534aa8a5d8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.647405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dab989-ca9d-470b-a917-be534aa8a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.647678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dab989-ca9d-470b-a917-be534aa8a5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.668102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a8dab989-ca9d-470b-a917-be534aa8a5d8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:29.669464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a8dab989-ca9d-470b-a917-be534aa8a5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:29.680005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:29.693464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9d276-64c1-4456-bdf2-645f36c41f6a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.731246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ad1a6-0817-4826-9471-d55ec83b9c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.731896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad1a6-0817-4826-9471-d55ec83b9c64 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.732170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad1a6-0817-4826-9471-d55ec83b9c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.732436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad1a6-0817-4826-9471-d55ec83b9c64 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.740383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ad1a6-0817-4826-9471-d55ec83b9c64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:29.741856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ad1a6-0817-4826-9471-d55ec83b9c64 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:29.748429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 295/573] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:29.749530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dab989-ca9d-470b-a917-be534aa8a5d8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9c5ad1a6-0817-4826-9471-d55ec83b9c64 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:29.753474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:29.754553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:14:29.755531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:29.759467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 279/574] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:29.760382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ad1a6-0817-4826-9471-d55ec83b9c64 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.792101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:29.862616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dab989-ca9d-470b-a917-be534aa8a5d8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.867803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ad1a6-0817-4826-9471-d55ec83b9c64 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:29.897928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f767fd3-3efc-4d84-bdc6-6ecc454a4a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.898581 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f767fd3-3efc-4d84-bdc6-6ecc454a4a25 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.898855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f767fd3-3efc-4d84-bdc6-6ecc454a4a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.899127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f767fd3-3efc-4d84-bdc6-6ecc454a4a25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.903877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d294c-748b-446e-8f03-829eaf1bc6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:29.904535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d294c-748b-446e-8f03-829eaf1bc6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:29.904817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d294c-748b-446e-8f03-829eaf1bc6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:29.905094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d294c-748b-446e-8f03-829eaf1bc6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:29.906859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f767fd3-3efc-4d84-bdc6-6ecc454a4a25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:29.908340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f767fd3-3efc-4d84-bdc6-6ecc454a4a25 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:29.917648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d294c-748b-446e-8f03-829eaf1bc6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:29.919103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d294c-748b-446e-8f03-829eaf1bc6b8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8f767fd3-3efc-4d84-bdc6-6ecc454a4a25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:29.920844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:29.922012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:29.923233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:29.926749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 296/575] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:29.927643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f767fd3-3efc-4d84-bdc6-6ecc454a4a25 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:29.931412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-df1d294c-748b-446e-8f03-829eaf1bc6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:29.939865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:29.940867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:29.941837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:29.941837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:29.941837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:29.941837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:29.944589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 280/576] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:29.945607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d294c-748b-446e-8f03-829eaf1bc6b8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.039960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:30.043116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f767fd3-3efc-4d84-bdc6-6ecc454a4a25 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.056922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d294c-748b-446e-8f03-829eaf1bc6b8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.082381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9201ec-cf3b-44c9-81e8-c6b8e775231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.083864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9201ec-cf3b-44c9-81e8-c6b8e775231d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.084426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9201ec-cf3b-44c9-81e8-c6b8e775231d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.084875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9201ec-cf3b-44c9-81e8-c6b8e775231d None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.086468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9201ec-cf3b-44c9-81e8-c6b8e775231d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:30.087250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9201ec-cf3b-44c9-81e8-c6b8e775231d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.088951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9201ec-cf3b-44c9-81e8-c6b8e775231d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.090743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e92ed9-9c9f-43b4-b43f-315844e252fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.091401 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e92ed9-9c9f-43b4-b43f-315844e252fc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.091683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e92ed9-9c9f-43b4-b43f-315844e252fc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.091959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e92ed9-9c9f-43b4-b43f-315844e252fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.103188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e92ed9-9c9f-43b4-b43f-315844e252fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-17e92ed9-9c9f-43b4-b43f-315844e252fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:30.108605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:30.109634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 281/577] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:30.116169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e92ed9-9c9f-43b4-b43f-315844e252fc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.116954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 297/578] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 26 07:14:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:30.116954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9201ec-cf3b-44c9-81e8-c6b8e775231d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.185498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:30.228620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9201ec-cf3b-44c9-81e8-c6b8e775231d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.239088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e92ed9-9c9f-43b4-b43f-315844e252fc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.266526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1fc90-0462-4a7f-9895-628372665557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.267168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1fc90-0462-4a7f-9895-628372665557 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.267444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1fc90-0462-4a7f-9895-628372665557 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.267717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1fc90-0462-4a7f-9895-628372665557 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.268415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1fc90-0462-4a7f-9895-628372665557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:30.268748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1fc90-0462-4a7f-9895-628372665557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.270160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1fc90-0462-4a7f-9895-628372665557 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.272933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344361f-cab5-4f9d-9d08-29472f724f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.273639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344361f-cab5-4f9d-9d08-29472f724f72 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.273916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344361f-cab5-4f9d-9d08-29472f724f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.274186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344361f-cab5-4f9d-9d08-29472f724f72 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.274977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344361f-cab5-4f9d-9d08-29472f724f72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:30.275282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344361f-cab5-4f9d-9d08-29472f724f72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.276975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344361f-cab5-4f9d-9d08-29472f724f72 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.282138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 298/579] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:30.282963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1fc90-0462-4a7f-9895-628372665557 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.297510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 282/580] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:30.298752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344361f-cab5-4f9d-9d08-29472f724f72 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.302403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:30.403302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1fc90-0462-4a7f-9895-628372665557 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.406655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344361f-cab5-4f9d-9d08-29472f724f72 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.430766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:30.444165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d434360-7a52-497c-8566-447d42574194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.444801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d434360-7a52-497c-8566-447d42574194 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.445083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d434360-7a52-497c-8566-447d42574194 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.445387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d434360-7a52-497c-8566-447d42574194 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.446220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d434360-7a52-497c-8566-447d42574194 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:30.446319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a6e9-23f9-48de-bc14-2f1e6b49a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.446531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d434360-7a52-497c-8566-447d42574194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.446921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a6e9-23f9-48de-bc14-2f1e6b49a463 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.447204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a6e9-23f9-48de-bc14-2f1e6b49a463 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.447475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a6e9-23f9-48de-bc14-2f1e6b49a463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.447910 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d434360-7a52-497c-8566-447d42574194 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.458305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164a6e9-23f9-48de-bc14-2f1e6b49a463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.459758 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164a6e9-23f9-48de-bc14-2f1e6b49a463 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.460992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 299/581] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:30.462547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d434360-7a52-497c-8566-447d42574194 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1164a6e9-23f9-48de-bc14-2f1e6b49a463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:30.475585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:30.476722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:30.478005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:30.478005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:30.478005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:30.478005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:30.481496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 283/582] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:30.482415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a6e9-23f9-48de-bc14-2f1e6b49a463 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.547185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:30.576238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d434360-7a52-497c-8566-447d42574194 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.600813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a6e9-23f9-48de-bc14-2f1e6b49a463 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.614160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d6900-4a21-4768-9025-eea8373b5c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.614963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6900-4a21-4768-9025-eea8373b5c87 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.615085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6900-4a21-4768-9025-eea8373b5c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.615348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6900-4a21-4768-9025-eea8373b5c87 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.624729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d6900-4a21-4768-9025-eea8373b5c87 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.626225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d6900-4a21-4768-9025-eea8373b5c87 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.636718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63a445-38a3-4ad7-8ba8-fcd243f1ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.637416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63a445-38a3-4ad7-8ba8-fcd243f1ea7a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.637704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63a445-38a3-4ad7-8ba8-fcd243f1ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.637970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63a445-38a3-4ad7-8ba8-fcd243f1ea7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-fd3d6900-4a21-4768-9025-eea8373b5c87 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:30.639027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:30.639940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:14:30.640911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:30.645342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 300/583] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:30.646236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d6900-4a21-4768-9025-eea8373b5c87 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.650245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63a445-38a3-4ad7-8ba8-fcd243f1ea7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.651711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63a445-38a3-4ad7-8ba8-fcd243f1ea7a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7c63a445-38a3-4ad7-8ba8-fcd243f1ea7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:30.666615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:30.667545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:30.668463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:30.668463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:30.668463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:30.668463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:30.668463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 284/584] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:30.669173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63a445-38a3-4ad7-8ba8-fcd243f1ea7a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.702363 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:30.760065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d6900-4a21-4768-9025-eea8373b5c87 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.782207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63a445-38a3-4ad7-8ba8-fcd243f1ea7a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.791895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:30.794588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301aaf-021e-4030-a612-5304b2a55240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.795241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301aaf-021e-4030-a612-5304b2a55240 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.795522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301aaf-021e-4030-a612-5304b2a55240 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.795796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301aaf-021e-4030-a612-5304b2a55240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.807864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27301aaf-021e-4030-a612-5304b2a55240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.809880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27301aaf-021e-4030-a612-5304b2a55240 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.822628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0553c-6297-4b0e-903d-dd2ec6367944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.823264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0553c-6297-4b0e-903d-dd2ec6367944 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.823582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0553c-6297-4b0e-903d-dd2ec6367944 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.823819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0553c-6297-4b0e-903d-dd2ec6367944 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.824522 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0553c-6297-4b0e-903d-dd2ec6367944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:30.824827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0553c-6297-4b0e-903d-dd2ec6367944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-27301aaf-021e-4030-a612-5304b2a55240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:30.824986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:30.825875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:30.826811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:30.826811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:30.826811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:30.826811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:30.827054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0553c-6297-4b0e-903d-dd2ec6367944 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.829404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 301/585] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:30.830525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301aaf-021e-4030-a612-5304b2a55240 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.840555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 285/586] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:30.841429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0553c-6297-4b0e-903d-dd2ec6367944 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:30.929577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:30.937006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301aaf-021e-4030-a612-5304b2a55240 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.944638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0553c-6297-4b0e-903d-dd2ec6367944 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:30.973955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc20391-df10-4575-b1fe-3ab56e6d018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.974694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc20391-df10-4575-b1fe-3ab56e6d018c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.974973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc20391-df10-4575-b1fe-3ab56e6d018c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.975240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc20391-df10-4575-b1fe-3ab56e6d018c None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.976036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc20391-df10-4575-b1fe-3ab56e6d018c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:30.976337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc20391-df10-4575-b1fe-3ab56e6d018c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.977985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc20391-df10-4575-b1fe-3ab56e6d018c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:30.982161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242361af-ed69-45d8-b933-ce6d14f2a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:30.982794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242361af-ed69-45d8-b933-ce6d14f2a140 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:30.983073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242361af-ed69-45d8-b933-ce6d14f2a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:30.983346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242361af-ed69-45d8-b933-ce6d14f2a140 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:30.984043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242361af-ed69-45d8-b933-ce6d14f2a140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:30.984344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242361af-ed69-45d8-b933-ce6d14f2a140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:30.985866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242361af-ed69-45d8-b933-ce6d14f2a140 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.000360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 302/587] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:31.000360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc20391-df10-4575-b1fe-3ab56e6d018c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.000609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 286/588] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:31.000609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242361af-ed69-45d8-b933-ce6d14f2a140 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.037055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:31.111586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc20391-df10-4575-b1fe-3ab56e6d018c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.121130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242361af-ed69-45d8-b933-ce6d14f2a140 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.151750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d1938-de0c-4a64-8935-548aa5c8b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.152442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d1938-de0c-4a64-8935-548aa5c8b473 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.152782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d1938-de0c-4a64-8935-548aa5c8b473 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.153239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d1938-de0c-4a64-8935-548aa5c8b473 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.154020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d1938-de0c-4a64-8935-548aa5c8b473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:31.154275 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d1938-de0c-4a64-8935-548aa5c8b473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.155705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d1938-de0c-4a64-8935-548aa5c8b473 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.170248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee278f1-eff0-4918-bb6b-f18e294332a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.171171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 303/589] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:31.171573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee278f1-eff0-4918-bb6b-f18e294332a5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.172025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d1938-de0c-4a64-8935-548aa5c8b473 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.172238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee278f1-eff0-4918-bb6b-f18e294332a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.172718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee278f1-eff0-4918-bb6b-f18e294332a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.184105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee278f1-eff0-4918-bb6b-f18e294332a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.185712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee278f1-eff0-4918-bb6b-f18e294332a5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.194685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cee278f1-eff0-4918-bb6b-f18e294332a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:31.199510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:31.200577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 287/590] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:31.206841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee278f1-eff0-4918-bb6b-f18e294332a5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.300128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d1938-de0c-4a64-8935-548aa5c8b473 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.303485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:31.320258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee278f1-eff0-4918-bb6b-f18e294332a5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.336630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa075-6698-4677-b953-0204141f8ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.337571 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa075-6698-4677-b953-0204141f8ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.337855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa075-6698-4677-b953-0204141f8ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.338137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa075-6698-4677-b953-0204141f8ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.353346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfa075-6698-4677-b953-0204141f8ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.355004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfa075-6698-4677-b953-0204141f8ba2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.356947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fc692-45b4-42de-984e-68ce7fe0fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.357970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fc692-45b4-42de-984e-68ce7fe0fb9c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.358257 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fc692-45b4-42de-984e-68ce7fe0fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.358560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fc692-45b4-42de-984e-68ce7fe0fb9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.366015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fc692-45b4-42de-984e-68ce7fe0fb9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.367482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fc692-45b4-42de-984e-68ce7fe0fb9c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-addfa075-6698-4677-b953-0204141f8ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:31.371798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:31.372668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:31.373596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:31.373596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:31.373596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:31.373596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:31.374559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 304/591] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:31.378220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa075-6698-4677-b953-0204141f8ba2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-154fc692-45b4-42de-984e-68ce7fe0fb9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:31.379969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:31.381017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:31.382147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:31.382147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:31.382147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:31.382147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:31.382147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:31.382147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:31.382147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:31.382147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:31.385399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 288/592] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:31.386391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fc692-45b4-42de-984e-68ce7fe0fb9c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.456462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:31.494158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa075-6698-4677-b953-0204141f8ba2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.496342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fc692-45b4-42de-984e-68ce7fe0fb9c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.527805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116df24-89d6-4fc6-a78f-923c188941c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.528464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116df24-89d6-4fc6-a78f-923c188941c4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.528748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116df24-89d6-4fc6-a78f-923c188941c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.528915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23392eef-8c24-4a4d-a8e4-3269623ccc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.529051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116df24-89d6-4fc6-a78f-923c188941c4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.529581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23392eef-8c24-4a4d-a8e4-3269623ccc92 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.529863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23392eef-8c24-4a4d-a8e4-3269623ccc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.530137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23392eef-8c24-4a4d-a8e4-3269623ccc92 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.530900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23392eef-8c24-4a4d-a8e4-3269623ccc92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:31.531206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23392eef-8c24-4a4d-a8e4-3269623ccc92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.532652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23392eef-8c24-4a4d-a8e4-3269623ccc92 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.536802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116df24-89d6-4fc6-a78f-923c188941c4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.538266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116df24-89d6-4fc6-a78f-923c188941c4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.545083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 289/593] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:31.545939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23392eef-8c24-4a4d-a8e4-3269623ccc92 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d116df24-89d6-4fc6-a78f-923c188941c4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:31.550371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:31.551360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 305/594] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:31.552924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116df24-89d6-4fc6-a78f-923c188941c4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.559206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:31.650163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23392eef-8c24-4a4d-a8e4-3269623ccc92 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.653953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116df24-89d6-4fc6-a78f-923c188941c4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.679031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:31.684275 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a063b-4b9e-479b-a11d-48623b9d93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.684907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a063b-4b9e-479b-a11d-48623b9d93ad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.685185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a063b-4b9e-479b-a11d-48623b9d93ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.685489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a063b-4b9e-479b-a11d-48623b9d93ad None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.686200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a063b-4b9e-479b-a11d-48623b9d93ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:31.686484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a063b-4b9e-479b-a11d-48623b9d93ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.687861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a063b-4b9e-479b-a11d-48623b9d93ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.688474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098bc51-003f-425d-bbc5-edc5c818a3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.689100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098bc51-003f-425d-bbc5-edc5c818a3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.689415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098bc51-003f-425d-bbc5-edc5c818a3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.689688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098bc51-003f-425d-bbc5-edc5c818a3d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.690455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098bc51-003f-425d-bbc5-edc5c818a3d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:31.690839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098bc51-003f-425d-bbc5-edc5c818a3d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.692272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098bc51-003f-425d-bbc5-edc5c818a3d7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.699876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 290/595] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:31.701144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1866-168e-4711-af12-dedc93d311eb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.701456 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1866-168e-4711-af12-dedc93d311eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.701732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1866-168e-4711-af12-dedc93d311eb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.702978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 291/596] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:31.705429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1866-168e-4711-af12-dedc93d311eb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.707629 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 306/597] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:31.708407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098bc51-003f-425d-bbc5-edc5c818a3d7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.771259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:31.808607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1866-168e-4711-af12-dedc93d311eb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.809721 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098bc51-003f-425d-bbc5-edc5c818a3d7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:31.842268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e42ed-7ecc-4200-aeea-34ca72698144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.843324 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e42ed-7ecc-4200-aeea-34ca72698144 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.843609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e42ed-7ecc-4200-aeea-34ca72698144 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.843881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e42ed-7ecc-4200-aeea-34ca72698144 None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/2ecb8054ea4249d18903b5998fa753d6/roles/726231471ff241e9af5bcf89430bd2c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.845340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40157-3b08-407c-84e9-36548fe7df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:31.845997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40157-3b08-407c-84e9-36548fe7df38 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.846275 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40157-3b08-407c-84e9-36548fe7df38 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.846551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40157-3b08-407c-84e9-36548fe7df38 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.848426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40157-3b08-407c-84e9-36548fe7df38 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:31.848426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40157-3b08-407c-84e9-36548fe7df38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.849362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40157-3b08-407c-84e9-36548fe7df38 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.861446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e42ed-7ecc-4200-aeea-34ca72698144 None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=2ecb8054ea4249d18903b5998fa753d6, role_id=726231471ff241e9af5bcf89430bd2c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:31.863271 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e42ed-7ecc-4200-aeea-34ca72698144 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:31.869651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 307/598] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jul 26 07:14:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:31.870651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40157-3b08-407c-84e9-36548fe7df38 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:31.882282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 292/599] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:14:31 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/2ecb8054ea4249d18903b5998fa753d6/roles/726231471ff241e9af5bcf89430bd2c0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:31.883602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf769-9f4f-41a9-ad46-c4daf6f7edd5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:31.883894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf769-9f4f-41a9-ad46-c4daf6f7edd5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:31.884155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf769-9f4f-41a9-ad46-c4daf6f7edd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:31.905424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7a8bf769-9f4f-41a9-ad46-c4daf6f7edd5 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:31.906743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7a8bf769-9f4f-41a9-ad46-c4daf6f7edd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:31.927777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:31.988304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 293/600] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:31.989180 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf769-9f4f-41a9-ad46-c4daf6f7edd5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.007164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40157-3b08-407c-84e9-36548fe7df38 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.045726 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:32.049497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d94e3-2a38-456b-8034-74f09aa5e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.050236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d94e3-2a38-456b-8034-74f09aa5e52a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.050518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d94e3-2a38-456b-8034-74f09aa5e52a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.050787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d94e3-2a38-456b-8034-74f09aa5e52a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.062966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d94e3-2a38-456b-8034-74f09aa5e52a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:32.064467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d94e3-2a38-456b-8034-74f09aa5e52a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7a0d94e3-2a38-456b-8034-74f09aa5e52a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:32.078761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:32.079739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:32.080659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:32.080659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:32.080659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:32.080659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:32.080659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:32.080659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:32.080659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:32.080659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:32.084440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 308/601] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:32.085772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d94e3-2a38-456b-8034-74f09aa5e52a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.115072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf769-9f4f-41a9-ad46-c4daf6f7edd5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.154851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab4da-0749-4f5b-835e-e638e1a1dab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.156156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab4da-0749-4f5b-835e-e638e1a1dab9 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.156696 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab4da-0749-4f5b-835e-e638e1a1dab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.157107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab4da-0749-4f5b-835e-e638e1a1dab9 None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/c70a0ca34a3940d1b067430c9c2dc64e/roles/726231471ff241e9af5bcf89430bd2c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.177853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab4da-0749-4f5b-835e-e638e1a1dab9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=c70a0ca34a3940d1b067430c9c2dc64e, role_id=726231471ff241e9af5bcf89430bd2c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:32.179690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab4da-0749-4f5b-835e-e638e1a1dab9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:32.195654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 294/602] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:14:31 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/c70a0ca34a3940d1b067430c9c2dc64e/roles/726231471ff241e9af5bcf89430bd2c0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:32.196872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab4da-0749-4f5b-835e-e638e1a1dab9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.208867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d94e3-2a38-456b-8034-74f09aa5e52a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.232225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:32.259089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3b4c3-2872-478a-930a-1b72ca7442af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.259999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3b4c3-2872-478a-930a-1b72ca7442af None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.260388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3b4c3-2872-478a-930a-1b72ca7442af None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.260761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3b4c3-2872-478a-930a-1b72ca7442af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.276212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3b4c3-2872-478a-930a-1b72ca7442af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:32.280711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3b4c3-2872-478a-930a-1b72ca7442af None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-eef3b4c3-2872-478a-930a-1b72ca7442af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:32.299039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:32.300200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:32.301108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:32.301108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:32.301108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:32.301108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:32.303948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 309/603] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:32.305204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3b4c3-2872-478a-930a-1b72ca7442af None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.320666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:32.329995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab4da-0749-4f5b-835e-e638e1a1dab9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.386158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161168-cc0f-4b28-9b80-ac1294b38e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.386832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161168-cc0f-4b28-9b80-ac1294b38e9f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.387107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161168-cc0f-4b28-9b80-ac1294b38e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.387415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161168-cc0f-4b28-9b80-ac1294b38e9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.402183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64161168-cc0f-4b28-9b80-ac1294b38e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-64161168-cc0f-4b28-9b80-ac1294b38e9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:32.408179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:32.409181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:32.410150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:32.411067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 295/604] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:32.411269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161168-cc0f-4b28-9b80-ac1294b38e9f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.439970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3b4c3-2872-478a-930a-1b72ca7442af None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.487101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b9510-899f-4e8b-a170-f5e805617830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.488019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b9510-899f-4e8b-a170-f5e805617830 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.488305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b9510-899f-4e8b-a170-f5e805617830 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.489007 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b9510-899f-4e8b-a170-f5e805617830 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.490067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b9510-899f-4e8b-a170-f5e805617830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:32.490388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b9510-899f-4e8b-a170-f5e805617830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:32.491941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b9510-899f-4e8b-a170-f5e805617830 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:32.509028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 310/605] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:32.510196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b9510-899f-4e8b-a170-f5e805617830 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.532987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161168-cc0f-4b28-9b80-ac1294b38e9f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.533591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:32.578305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c49930-1282-4735-80b8-54b1c53dee0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.579368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49930-1282-4735-80b8-54b1c53dee0e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.579743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49930-1282-4735-80b8-54b1c53dee0e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.580106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49930-1282-4735-80b8-54b1c53dee0e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.580916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c49930-1282-4735-80b8-54b1c53dee0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:32.581398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c49930-1282-4735-80b8-54b1c53dee0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:32.583590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c49930-1282-4735-80b8-54b1c53dee0e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:32.601352 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 296/606] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:32.602229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c49930-1282-4735-80b8-54b1c53dee0e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.623682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:32.649087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b9510-899f-4e8b-a170-f5e805617830 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.688254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fca8f-d657-4aa7-9736-f667421d2dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.689306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fca8f-d657-4aa7-9736-f667421d2dca None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.689782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fca8f-d657-4aa7-9736-f667421d2dca None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.690266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fca8f-d657-4aa7-9736-f667421d2dca None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.691405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fca8f-d657-4aa7-9736-f667421d2dca None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:32.691901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fca8f-d657-4aa7-9736-f667421d2dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:32.693528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fca8f-d657-4aa7-9736-f667421d2dca None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:32.703516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 311/607] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:32.704880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fca8f-d657-4aa7-9736-f667421d2dca None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.710765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c49930-1282-4735-80b8-54b1c53dee0e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.746820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c84f3a-2124-4ac5-9e5b-b1eefef6b900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.747517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c84f3a-2124-4ac5-9e5b-b1eefef6b900 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.747802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c84f3a-2124-4ac5-9e5b-b1eefef6b900 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.748077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c84f3a-2124-4ac5-9e5b-b1eefef6b900 None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/59f6195586c7434ab85604181ec2a076/roles/726231471ff241e9af5bcf89430bd2c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.763487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c84f3a-2124-4ac5-9e5b-b1eefef6b900 None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=59f6195586c7434ab85604181ec2a076, role_id=726231471ff241e9af5bcf89430bd2c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:32.764938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c84f3a-2124-4ac5-9e5b-b1eefef6b900 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:32.780604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 297/608] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:14:32 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/59f6195586c7434ab85604181ec2a076/roles/726231471ff241e9af5bcf89430bd2c0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:32.781900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c84f3a-2124-4ac5-9e5b-b1eefef6b900 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.798996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:32.825243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fca8f-d657-4aa7-9736-f667421d2dca None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.863956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:32.866620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab11154-d5a8-4ac2-9eed-3092079e4687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.867538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab11154-d5a8-4ac2-9eed-3092079e4687 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.868056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab11154-d5a8-4ac2-9eed-3092079e4687 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.868591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab11154-d5a8-4ac2-9eed-3092079e4687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.877573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab11154-d5a8-4ac2-9eed-3092079e4687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:32.879553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab11154-d5a8-4ac2-9eed-3092079e4687 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3ab11154-d5a8-4ac2-9eed-3092079e4687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:32.895634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:32.896691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:32.897669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:32.897669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:32.897669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:32.897669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:32.897669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:32.897669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:32.897669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:32.897669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:32.900461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 312/609] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:32.906272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab11154-d5a8-4ac2-9eed-3092079e4687 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:32.906509 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c84f3a-2124-4ac5-9e5b-b1eefef6b900 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:32.945203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31319a97-05b7-4cbc-af4c-9ccdc1394b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:32.946653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31319a97-05b7-4cbc-af4c-9ccdc1394b85 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:32.946653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31319a97-05b7-4cbc-af4c-9ccdc1394b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:32.946653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31319a97-05b7-4cbc-af4c-9ccdc1394b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:32.959628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31319a97-05b7-4cbc-af4c-9ccdc1394b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:32.961328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31319a97-05b7-4cbc-af4c-9ccdc1394b85 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-31319a97-05b7-4cbc-af4c-9ccdc1394b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:32.979523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:32.980534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:32.981911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:32.981911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:32.981911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:32.981911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:32.981911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 298/610] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:32.987700 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31319a97-05b7-4cbc-af4c-9ccdc1394b85 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:33.039739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab11154-d5a8-4ac2-9eed-3092079e4687 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:33.099535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31319a97-05b7-4cbc-af4c-9ccdc1394b85 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:33.121017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:33.134165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f1935-270b-42cf-87b7-59430beac7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:33.134835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f1935-270b-42cf-87b7-59430beac7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:33.135121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f1935-270b-42cf-87b7-59430beac7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:33.135399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f1935-270b-42cf-87b7-59430beac7e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:33.136206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f1935-270b-42cf-87b7-59430beac7e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:33.136520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f1935-270b-42cf-87b7-59430beac7e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:33.138075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f1935-270b-42cf-87b7-59430beac7e6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:33.141171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07e02-4ff2-46ee-acde-fa6ba9b3cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:33.142100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07e02-4ff2-46ee-acde-fa6ba9b3cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:33.142557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07e02-4ff2-46ee-acde-fa6ba9b3cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:33.142980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07e02-4ff2-46ee-acde-fa6ba9b3cfd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:33.144039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07e02-4ff2-46ee-acde-fa6ba9b3cfd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:33.144351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07e02-4ff2-46ee-acde-fa6ba9b3cfd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:33.145820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07e02-4ff2-46ee-acde-fa6ba9b3cfd0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:33.151136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:33.159655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 299/611] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:33.159825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 313/612] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:33.165487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07e02-4ff2-46ee-acde-fa6ba9b3cfd0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:33.165877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f1935-270b-42cf-87b7-59430beac7e6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:33.290708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f1935-270b-42cf-87b7-59430beac7e6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:33.328580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a681-092b-4324-9041-39a07e31d47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:33.329682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a681-092b-4324-9041-39a07e31d47a None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:33.330176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a681-092b-4324-9041-39a07e31d47a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:33.331036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a681-092b-4324-9041-39a07e31d47a None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/7eab2497edff4c968030b5b0d6814150/roles/726231471ff241e9af5bcf89430bd2c0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:33.341214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07e02-4ff2-46ee-acde-fa6ba9b3cfd0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:33.348965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a681-092b-4324-9041-39a07e31d47a None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=7eab2497edff4c968030b5b0d6814150, role_id=726231471ff241e9af5bcf89430bd2c0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:33.350812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a681-092b-4324-9041-39a07e31d47a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:33.376170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 314/613] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:14:33 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/7eab2497edff4c968030b5b0d6814150/roles/726231471ff241e9af5bcf89430bd2c0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:33.394704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c5c23-5e5c-42c4-8a67-74f780cca773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:33.395762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5c23-5e5c-42c4-8a67-74f780cca773 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:33.396281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5c23-5e5c-42c4-8a67-74f780cca773 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:33.396759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5c23-5e5c-42c4-8a67-74f780cca773 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:33.405484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c5c23-5e5c-42c4-8a67-74f780cca773 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:33.407433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c5c23-5e5c-42c4-8a67-74f780cca773 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d89c5c23-5e5c-42c4-8a67-74f780cca773 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:33.422416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:33.423437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:33.424397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:33.427325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 300/614] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:33.433489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a681-092b-4324-9041-39a07e31d47a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:33.503188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:33.577116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a681-092b-4324-9041-39a07e31d47a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:33.620897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcae7d-30bb-4a94-a17e-aeca91102fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:33.621985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcae7d-30bb-4a94-a17e-aeca91102fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:33.622494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcae7d-30bb-4a94-a17e-aeca91102fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:33.622954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcae7d-30bb-4a94-a17e-aeca91102fb0 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:33.624029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcae7d-30bb-4a94-a17e-aeca91102fb0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:33.624549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcae7d-30bb-4a94-a17e-aeca91102fb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:33.626266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcae7d-30bb-4a94-a17e-aeca91102fb0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:33.649300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 315/615] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 26 07:14:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:33.654848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c5c23-5e5c-42c4-8a67-74f780cca773 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:33.700442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:33.765528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c5c23-5e5c-42c4-8a67-74f780cca773 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:33.800674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec7dee-7188-4012-bda9-46797b397579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:33.801442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec7dee-7188-4012-bda9-46797b397579 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:33.801723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec7dee-7188-4012-bda9-46797b397579 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:33.801987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec7dee-7188-4012-bda9-46797b397579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:33.813607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec7dee-7188-4012-bda9-46797b397579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:33.815142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec7dee-7188-4012-bda9-46797b397579 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-82ec7dee-7188-4012-bda9-46797b397579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:33.830547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:33.831537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:33.832460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:33.832460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:33.832460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:33.832460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:33.832460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 301/616] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:33.837824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcae7d-30bb-4a94-a17e-aeca91102fb0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:33.962325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcae7d-30bb-4a94-a17e-aeca91102fb0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:33.972898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:34.006626 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4113b23-a701-46c1-a725-9c271301b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:34.007261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4113b23-a701-46c1-a725-9c271301b145 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.007585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4113b23-a701-46c1-a725-9c271301b145 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.007861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4113b23-a701-46c1-a725-9c271301b145 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.008571 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4113b23-a701-46c1-a725-9c271301b145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:34.008863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4113b23-a701-46c1-a725-9c271301b145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:34.010289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4113b23-a701-46c1-a725-9c271301b145 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:34.025439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 316/617] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:34.030999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec7dee-7188-4012-bda9-46797b397579 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:34.123248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:34.132708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec7dee-7188-4012-bda9-46797b397579 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:34.167530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9f2f7-4401-4644-a466-2322a2306e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:34.168178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f2f7-4401-4644-a466-2322a2306e67 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.168454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f2f7-4401-4644-a466-2322a2306e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.168719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f2f7-4401-4644-a466-2322a2306e67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.175687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9f2f7-4401-4644-a466-2322a2306e67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:34.177137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9f2f7-4401-4644-a466-2322a2306e67 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-20d9f2f7-4401-4644-a466-2322a2306e67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:34.188963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:34.189945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:34.191096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:34.191096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:34.191096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:34.191096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:34.191096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:34.191096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:34.191096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:34.191096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:34.191096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 302/618] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:34.196850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4113b23-a701-46c1-a725-9c271301b145 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:34.257521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4d230-10e1-4398-aac0-06782ac1ad77 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.257924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4d230-10e1-4398-aac0-06782ac1ad77 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.258173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4d230-10e1-4398-aac0-06782ac1ad77 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.259550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 303/619] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:14:34.270951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdfa98-87e1-401c-a322-475d8f39e212 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.271231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdfa98-87e1-401c-a322-475d8f39e212 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.271502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdfa98-87e1-401c-a322-475d8f39e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.305788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-00bdfa98-87e1-401c-a322-475d8f39e212 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:34.307513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-00bdfa98-87e1-401c-a322-475d8f39e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:34.346562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4113b23-a701-46c1-a725-9c271301b145 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:34.404821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 304/620] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:34.411630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9a291-a95b-40b5-bf0b-fa3bf907d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:34.411630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9a291-a95b-40b5-bf0b-fa3bf907d062 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.411630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9a291-a95b-40b5-bf0b-fa3bf907d062 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.411630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9a291-a95b-40b5-bf0b-fa3bf907d062 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.412075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9a291-a95b-40b5-bf0b-fa3bf907d062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:34.412075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9a291-a95b-40b5-bf0b-fa3bf907d062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:34.412075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9a291-a95b-40b5-bf0b-fa3bf907d062 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:34.424237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 317/621] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:34.430238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdfa98-87e1-401c-a322-475d8f39e212 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:34.431387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9a291-a95b-40b5-bf0b-fa3bf907d062 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:34.463881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:34.546314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9a291-a95b-40b5-bf0b-fa3bf907d062 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:34.575470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:34.595766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d5b6-de4b-4823-9b85-cb1b19c1e59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:34.596528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d5b6-de4b-4823-9b85-cb1b19c1e59a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.596880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d5b6-de4b-4823-9b85-cb1b19c1e59a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.597162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d5b6-de4b-4823-9b85-cb1b19c1e59a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.598860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdfa98-87e1-401c-a322-475d8f39e212 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:34.613793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d5b6-de4b-4823-9b85-cb1b19c1e59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-73d3d5b6-de4b-4823-9b85-cb1b19c1e59a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:34.619150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:34.620155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:34.621037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 318/622] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:34.626537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d5b6-de4b-4823-9b85-cb1b19c1e59a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:34.663989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0946c-d2e0-43d0-899b-dcff25869951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:34.665596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0946c-d2e0-43d0-899b-dcff25869951 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.666139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0946c-d2e0-43d0-899b-dcff25869951 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.666613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0946c-d2e0-43d0-899b-dcff25869951 None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/b5a03e5f2dee4bdeac26236d8127588c/roles/726231471ff241e9af5bcf89430bd2c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.683273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0946c-d2e0-43d0-899b-dcff25869951 None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=b5a03e5f2dee4bdeac26236d8127588c, role_id=726231471ff241e9af5bcf89430bd2c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:34.685143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0946c-d2e0-43d0-899b-dcff25869951 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:34.708525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 305/623] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:14:34 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/b5a03e5f2dee4bdeac26236d8127588c/roles/726231471ff241e9af5bcf89430bd2c0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:34.710363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf4be1-fd67-483c-bd8e-57f825f21c48 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.710985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf4be1-fd67-483c-bd8e-57f825f21c48 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.711499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf4be1-fd67-483c-bd8e-57f825f21c48 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.713362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 306/624] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:34.720104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bac26a-4ad5-452d-8675-5bf066062ce2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.720755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bac26a-4ad5-452d-8675-5bf066062ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.721249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:34.722642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bac26a-4ad5-452d-8675-5bf066062ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.739924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d5b6-de4b-4823-9b85-cb1b19c1e59a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:34.745953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d4bac26a-4ad5-452d-8675-5bf066062ce2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:34.747656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d4bac26a-4ad5-452d-8675-5bf066062ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:34.780049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa387322-681d-4175-a753-7baa29806718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:34.780750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa387322-681d-4175-a753-7baa29806718 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.781031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa387322-681d-4175-a753-7baa29806718 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.781497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa387322-681d-4175-a753-7baa29806718 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:34.782351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa387322-681d-4175-a753-7baa29806718 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:34.782661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa387322-681d-4175-a753-7baa29806718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:34.784200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa387322-681d-4175-a753-7baa29806718 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:34.794889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 319/625] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:34.800841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa387322-681d-4175-a753-7baa29806718 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:34.827284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 307/626] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:34.851856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bac26a-4ad5-452d-8675-5bf066062ce2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:34.916461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa387322-681d-4175-a753-7baa29806718 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:34.922292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:34.981965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bac26a-4ad5-452d-8675-5bf066062ce2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:34.995748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822feeb-5f70-4d6f-8941-d1a3b0121c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:34.996432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822feeb-5f70-4d6f-8941-d1a3b0121c68 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:34.996676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822feeb-5f70-4d6f-8941-d1a3b0121c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:34.996941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822feeb-5f70-4d6f-8941-d1a3b0121c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.011792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822feeb-5f70-4d6f-8941-d1a3b0121c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:35.013293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822feeb-5f70-4d6f-8941-d1a3b0121c68 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:35.028821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546742-b8f1-4a6d-a44d-d76b429637d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:35.029068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546742-b8f1-4a6d-a44d-d76b429637d7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.029227 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546742-b8f1-4a6d-a44d-d76b429637d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.029529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546742-b8f1-4a6d-a44d-d76b429637d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.031822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8822feeb-5f70-4d6f-8941-d1a3b0121c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:35.040505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:35.041549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:35.042473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:35.042473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:35.042473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:35.042473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:35.042473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 320/627] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:35.048106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822feeb-5f70-4d6f-8941-d1a3b0121c68 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:35.054105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16546742-b8f1-4a6d-a44d-d76b429637d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-16546742-b8f1-4a6d-a44d-d76b429637d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:35.059901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:35.060895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:35.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:35.065647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 308/628] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:35.071752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546742-b8f1-4a6d-a44d-d76b429637d7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:35.204976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546742-b8f1-4a6d-a44d-d76b429637d7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:35.232980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:35.257297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61469f5a-a3a8-4c3c-97a7-f0b9db0619ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:35.257297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61469f5a-a3a8-4c3c-97a7-f0b9db0619ad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.257297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61469f5a-a3a8-4c3c-97a7-f0b9db0619ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.257297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61469f5a-a3a8-4c3c-97a7-f0b9db0619ad None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.257809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61469f5a-a3a8-4c3c-97a7-f0b9db0619ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:35.257809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61469f5a-a3a8-4c3c-97a7-f0b9db0619ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:35.257809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61469f5a-a3a8-4c3c-97a7-f0b9db0619ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:35.270130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 309/629] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:35.276604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61469f5a-a3a8-4c3c-97a7-f0b9db0619ad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:35.319466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822feeb-5f70-4d6f-8941-d1a3b0121c68 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:35.398052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb7e9b-2b58-4a24-a647-82fdbc15d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:35.401209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb7e9b-2b58-4a24-a647-82fdbc15d8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.401792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb7e9b-2b58-4a24-a647-82fdbc15d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.403358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb7e9b-2b58-4a24-a647-82fdbc15d8b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.404235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb7e9b-2b58-4a24-a647-82fdbc15d8b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:35.404745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb7e9b-2b58-4a24-a647-82fdbc15d8b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:35.406577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb7e9b-2b58-4a24-a647-82fdbc15d8b6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:35.429567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 321/630] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:35.431199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cbe90-a650-4b4c-a010-f52b1e72ede8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.431626 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cbe90-a650-4b4c-a010-f52b1e72ede8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.432065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cbe90-a650-4b4c-a010-f52b1e72ede8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.432672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61469f5a-a3a8-4c3c-97a7-f0b9db0619ad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:35.433949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 322/631] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:35.440969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cbe90-a650-4b4c-a010-f52b1e72ede8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:35.468863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebb43b-623b-4b0d-b1e2-0d81fb773d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:35.469465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb43b-623b-4b0d-b1e2-0d81fb773d56 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.469816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb43b-623b-4b0d-b1e2-0d81fb773d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.470009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb43b-623b-4b0d-b1e2-0d81fb773d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.481854 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebb43b-623b-4b0d-b1e2-0d81fb773d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:35.483319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebb43b-623b-4b0d-b1e2-0d81fb773d56 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1eebb43b-623b-4b0d-b1e2-0d81fb773d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:35.498610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:35.499759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:35.500886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:35.500886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:35.500886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:35.500886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:35.500886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 310/632] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:35.501305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1948ae-acbe-4f33-9ae6-8293bad3c489 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.506261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1948ae-acbe-4f33-9ae6-8293bad3c489 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.506580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1948ae-acbe-4f33-9ae6-8293bad3c489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.513632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:35.525614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ac1948ae-acbe-4f33-9ae6-8293bad3c489 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:35.526836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac1948ae-acbe-4f33-9ae6-8293bad3c489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:35.555211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:35.556870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cbe90-a650-4b4c-a010-f52b1e72ede8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:35.598595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c2265-5c77-48d8-8a99-5d9c3afb6ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:35.605599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 311/633] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:35.605599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1948ae-acbe-4f33-9ae6-8293bad3c489 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:35.607292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c2265-5c77-48d8-8a99-5d9c3afb6ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.611503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c2265-5c77-48d8-8a99-5d9c3afb6ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.611956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c2265-5c77-48d8-8a99-5d9c3afb6ea1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.626274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c2265-5c77-48d8-8a99-5d9c3afb6ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:35.627742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c2265-5c77-48d8-8a99-5d9c3afb6ea1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ed6c2265-5c77-48d8-8a99-5d9c3afb6ea1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:35.644846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:35.645911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 323/634] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:35.647267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c2265-5c77-48d8-8a99-5d9c3afb6ea1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:35.743203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1948ae-acbe-4f33-9ae6-8293bad3c489 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:35.781003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c2265-5c77-48d8-8a99-5d9c3afb6ea1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:35.786100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6417e-ef54-484f-bc2b-566ff6b4dd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:35.787019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6417e-ef54-484f-bc2b-566ff6b4dd78 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.787497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6417e-ef54-484f-bc2b-566ff6b4dd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.787988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6417e-ef54-484f-bc2b-566ff6b4dd78 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.789490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6417e-ef54-484f-bc2b-566ff6b4dd78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:35.790015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6417e-ef54-484f-bc2b-566ff6b4dd78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:35.792058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6417e-ef54-484f-bc2b-566ff6b4dd78 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:35.803099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:35.811448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 312/635] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:35.813075 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6417e-ef54-484f-bc2b-566ff6b4dd78 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:35.824418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928c995-a0c7-49fc-8b67-c5956a19f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:35.825310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928c995-a0c7-49fc-8b67-c5956a19f78d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.825423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928c995-a0c7-49fc-8b67-c5956a19f78d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.825675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928c995-a0c7-49fc-8b67-c5956a19f78d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.838055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928c995-a0c7-49fc-8b67-c5956a19f78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9928c995-a0c7-49fc-8b67-c5956a19f78d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:35.844082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:35.845056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:35.845957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:35.849173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:35.849529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 324/636] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:35.851769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928c995-a0c7-49fc-8b67-c5956a19f78d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:35.944136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6417e-ef54-484f-bc2b-566ff6b4dd78 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:35.982533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2f1d6-29fc-4c6a-b845-57e20e030fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:35.983170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2f1d6-29fc-4c6a-b845-57e20e030fda None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:35.983447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2f1d6-29fc-4c6a-b845-57e20e030fda None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:35.983974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2f1d6-29fc-4c6a-b845-57e20e030fda None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:35.984528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2f1d6-29fc-4c6a-b845-57e20e030fda None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:35.984829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2f1d6-29fc-4c6a-b845-57e20e030fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:35.986315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2f1d6-29fc-4c6a-b845-57e20e030fda None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:35.987668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928c995-a0c7-49fc-8b67-c5956a19f78d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:36.005485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 313/637] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 26 07:14:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:36.006290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2f1d6-29fc-4c6a-b845-57e20e030fda None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:36.031687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226b97e-fa9d-4aa9-887d-007cfa8fe5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:36.032968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226b97e-fa9d-4aa9-887d-007cfa8fe5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.033709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226b97e-fa9d-4aa9-887d-007cfa8fe5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.034161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226b97e-fa9d-4aa9-887d-007cfa8fe5b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.045010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226b97e-fa9d-4aa9-887d-007cfa8fe5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:36.046805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226b97e-fa9d-4aa9-887d-007cfa8fe5b5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b226b97e-fa9d-4aa9-887d-007cfa8fe5b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:36.062395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:36.063532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:36.064497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:36.068044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 325/638] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 26 07:14:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:36.069452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226b97e-fa9d-4aa9-887d-007cfa8fe5b5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:36.115925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:36.121629 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:36.132680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2f1d6-29fc-4c6a-b845-57e20e030fda None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:36.176207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866f9cd-f101-4ac6-ba73-dfe2b77812c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:36.177353 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866f9cd-f101-4ac6-ba73-dfe2b77812c7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.177993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866f9cd-f101-4ac6-ba73-dfe2b77812c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.178377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866f9cd-f101-4ac6-ba73-dfe2b77812c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.179209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866f9cd-f101-4ac6-ba73-dfe2b77812c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:36.179619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866f9cd-f101-4ac6-ba73-dfe2b77812c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:36.179724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226b97e-fa9d-4aa9-887d-007cfa8fe5b5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:36.181379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866f9cd-f101-4ac6-ba73-dfe2b77812c7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:36.192305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 314/639] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:36.193393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866f9cd-f101-4ac6-ba73-dfe2b77812c7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:36.226980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b4a8f-1cda-46ee-b631-7a51ea21aeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:36.227781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b4a8f-1cda-46ee-b631-7a51ea21aeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.228117 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b4a8f-1cda-46ee-b631-7a51ea21aeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.228708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b4a8f-1cda-46ee-b631-7a51ea21aeb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.303092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b4a8f-1cda-46ee-b631-7a51ea21aeb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:36.303302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866f9cd-f101-4ac6-ba73-dfe2b77812c7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:36.304583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b4a8f-1cda-46ee-b631-7a51ea21aeb6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:36.339072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c514f4-8a63-4694-badd-35e6ce7c23e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:36.340196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c514f4-8a63-4694-badd-35e6ce7c23e6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.340196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c514f4-8a63-4694-badd-35e6ce7c23e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.340391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c514f4-8a63-4694-badd-35e6ce7c23e6 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.341138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c514f4-8a63-4694-badd-35e6ce7c23e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:36.341472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c514f4-8a63-4694-badd-35e6ce7c23e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:36.343253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c514f4-8a63-4694-badd-35e6ce7c23e6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:36.347975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:36.366420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 315/640] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 26 07:14:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:36.366420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c514f4-8a63-4694-badd-35e6ce7c23e6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:36.370342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:36.418000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 326/641] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:36.418538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1605ab-0d17-4617-bd7c-f853989d42a0 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.418538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1605ab-0d17-4617-bd7c-f853989d42a0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.419293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1605ab-0d17-4617-bd7c-f853989d42a0 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.421144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 327/642] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:36.425992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1605ab-0d17-4617-bd7c-f853989d42a0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:36.480774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c514f4-8a63-4694-badd-35e6ce7c23e6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:36.519086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c94c53-7cff-4ae0-a116-13d8ba5e43a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:36.520173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c94c53-7cff-4ae0-a116-13d8ba5e43a3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.520524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c94c53-7cff-4ae0-a116-13d8ba5e43a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.520858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c94c53-7cff-4ae0-a116-13d8ba5e43a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.532396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c94c53-7cff-4ae0-a116-13d8ba5e43a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:36.533884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c94c53-7cff-4ae0-a116-13d8ba5e43a3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:36.534013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1605ab-0d17-4617-bd7c-f853989d42a0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-92c94c53-7cff-4ae0-a116-13d8ba5e43a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:36.549690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:36.550809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:36.551755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:36.551755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:36.551755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:36.551755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:36.551755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 316/643] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:36.551755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c94c53-7cff-4ae0-a116-13d8ba5e43a3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:36.577844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ff35-16a3-4403-b97f-eb67f5c73ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:36.578391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ff35-16a3-4403-b97f-eb67f5c73ddb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.578674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ff35-16a3-4403-b97f-eb67f5c73ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.578948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ff35-16a3-4403-b97f-eb67f5c73ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.590303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:36.615076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:36.651835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2ff35-16a3-4403-b97f-eb67f5c73ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:36.653625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2ff35-16a3-4403-b97f-eb67f5c73ddb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:36.666129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c94c53-7cff-4ae0-a116-13d8ba5e43a3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:36.708039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9d8f2-b532-4a3a-9073-133312fc6557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:36.708726 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9d8f2-b532-4a3a-9073-133312fc6557 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.709008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9d8f2-b532-4a3a-9073-133312fc6557 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.709307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9d8f2-b532-4a3a-9073-133312fc6557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.725869 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9d8f2-b532-4a3a-9073-133312fc6557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:36.727377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9d8f2-b532-4a3a-9073-133312fc6557 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-32f9d8f2-b532-4a3a-9073-133312fc6557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:36.747059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:36.748480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:36.754964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:36.754964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:36.754964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:36.754964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:36.754964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 317/644] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:36.754964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea588-4801-482c-83ce-75faedeb156a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.754964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea588-4801-482c-83ce-75faedeb156a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.754964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea588-4801-482c-83ce-75faedeb156a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.766054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 328/645] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:36.770987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ff35-16a3-4403-b97f-eb67f5c73ddb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:36.771072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-061ea588-4801-482c-83ce-75faedeb156a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:36.771842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-061ea588-4801-482c-83ce-75faedeb156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:36.814678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:36.840544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 318/646] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:36.841377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ea588-4801-482c-83ce-75faedeb156a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:36.885988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:36.888249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ff35-16a3-4403-b97f-eb67f5c73ddb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:36.924907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0e678-e6a5-4f87-9539-95aeb849c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:36.926042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0e678-e6a5-4f87-9539-95aeb849c31f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:36.926569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0e678-e6a5-4f87-9539-95aeb849c31f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:36.927382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0e678-e6a5-4f87-9539-95aeb849c31f None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:36.928559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0e678-e6a5-4f87-9539-95aeb849c31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:36.929060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0e678-e6a5-4f87-9539-95aeb849c31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:36.931187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0e678-e6a5-4f87-9539-95aeb849c31f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:36.948042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 329/647] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:36.949104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0e678-e6a5-4f87-9539-95aeb849c31f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:36.972117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ea588-4801-482c-83ce-75faedeb156a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.007170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cf057-eeac-4539-b8b3-828a4f9ea23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.007799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cf057-eeac-4539-b8b3-828a4f9ea23a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.008079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cf057-eeac-4539-b8b3-828a4f9ea23a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.008351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cf057-eeac-4539-b8b3-828a4f9ea23a None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.009147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cf057-eeac-4539-b8b3-828a4f9ea23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:37.009483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cf057-eeac-4539-b8b3-828a4f9ea23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:37.010872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cf057-eeac-4539-b8b3-828a4f9ea23a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:37.022182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 319/648] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:37.023391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00876d-f3de-4c27-9155-3b2d95cdc7f5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.023677 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00876d-f3de-4c27-9155-3b2d95cdc7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.023952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00876d-f3de-4c27-9155-3b2d95cdc7f5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.029143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 320/649] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:37.029143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00876d-f3de-4c27-9155-3b2d95cdc7f5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.053074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:37.056297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0e678-e6a5-4f87-9539-95aeb849c31f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.089668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918625-8870-4313-8554-1043a59dc26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.090313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918625-8870-4313-8554-1043a59dc26f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.090643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918625-8870-4313-8554-1043a59dc26f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.090861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918625-8870-4313-8554-1043a59dc26f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.101834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918625-8870-4313-8554-1043a59dc26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:37.103290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918625-8870-4313-8554-1043a59dc26f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-01918625-8870-4313-8554-1043a59dc26f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:37.117507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:37.118630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:37.119551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:37.119551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:37.119551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:37.119551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:37.119551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 330/650] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:37.119837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918625-8870-4313-8554-1043a59dc26f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.124077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:37.133777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00876d-f3de-4c27-9155-3b2d95cdc7f5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.167507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178c094-6e87-4dab-b119-9b26bbc3df08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.168298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c094-6e87-4dab-b119-9b26bbc3df08 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.168577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c094-6e87-4dab-b119-9b26bbc3df08 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.168845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c094-6e87-4dab-b119-9b26bbc3df08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.179074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178c094-6e87-4dab-b119-9b26bbc3df08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0178c094-6e87-4dab-b119-9b26bbc3df08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:37.184431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:37.185394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:37.186255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 321/651] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:37.186981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178c094-6e87-4dab-b119-9b26bbc3df08 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.225038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918625-8870-4313-8554-1043a59dc26f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.263726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2147c-ccde-41bc-a4a4-0187dd76fd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.264379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2147c-ccde-41bc-a4a4-0187dd76fd81 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.264653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2147c-ccde-41bc-a4a4-0187dd76fd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.264919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2147c-ccde-41bc-a4a4-0187dd76fd81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.272995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2147c-ccde-41bc-a4a4-0187dd76fd81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:37.274488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2147c-ccde-41bc-a4a4-0187dd76fd81 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-21b2147c-ccde-41bc-a4a4-0187dd76fd81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:37.286047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:37.287058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:14:37.288000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:37.289759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178c094-6e87-4dab-b119-9b26bbc3df08 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.291940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 331/652] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:37.293250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d22c6-2f02-4b2f-b058-e03411bbbaa4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.293559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d22c6-2f02-4b2f-b058-e03411bbbaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.293832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d22c6-2f02-4b2f-b058-e03411bbbaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.311343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-290d22c6-2f02-4b2f-b058-e03411bbbaa4 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:37.312563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-290d22c6-2f02-4b2f-b058-e03411bbbaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:37.319945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:37.323766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b95d3-7bb2-4e7b-8b47-b557fa6d550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.324411 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b95d3-7bb2-4e7b-8b47-b557fa6d550b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.324690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b95d3-7bb2-4e7b-8b47-b557fa6d550b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.324955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b95d3-7bb2-4e7b-8b47-b557fa6d550b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.331816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b95d3-7bb2-4e7b-8b47-b557fa6d550b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:37.333246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b95d3-7bb2-4e7b-8b47-b557fa6d550b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ab2b95d3-7bb2-4e7b-8b47-b557fa6d550b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:37.344949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:37.346126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 322/653] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:37.347066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b95d3-7bb2-4e7b-8b47-b557fa6d550b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.366355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:37.383540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 332/654] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:37.384380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d22c6-2f02-4b2f-b058-e03411bbbaa4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.466088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b95d3-7bb2-4e7b-8b47-b557fa6d550b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.485839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d22c6-2f02-4b2f-b058-e03411bbbaa4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.500872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98944e-7e22-4318-8632-f8fcf1764ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.501546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98944e-7e22-4318-8632-f8fcf1764ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.501831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98944e-7e22-4318-8632-f8fcf1764ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.502112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98944e-7e22-4318-8632-f8fcf1764ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.502816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98944e-7e22-4318-8632-f8fcf1764ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:37.503148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98944e-7e22-4318-8632-f8fcf1764ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:37.504540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98944e-7e22-4318-8632-f8fcf1764ba4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:37.517363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 323/655] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:37.518211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98944e-7e22-4318-8632-f8fcf1764ba4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.520431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93511-424b-4261-acca-e7d13721ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.521073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93511-424b-4261-acca-e7d13721ce0f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.521382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93511-424b-4261-acca-e7d13721ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.521655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93511-424b-4261-acca-e7d13721ce0f None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.522656 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93511-424b-4261-acca-e7d13721ce0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:37.522971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93511-424b-4261-acca-e7d13721ce0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:37.524363 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93511-424b-4261-acca-e7d13721ce0f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:37.532658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 333/656] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:37.533486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93511-424b-4261-acca-e7d13721ce0f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.538725 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:37.601101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:37.628337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98944e-7e22-4318-8632-f8fcf1764ba4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.640860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93511-424b-4261-acca-e7d13721ce0f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.670050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24ad0-c167-45c8-ad92-0aea53fd7813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.670800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24ad0-c167-45c8-ad92-0aea53fd7813 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.671087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24ad0-c167-45c8-ad92-0aea53fd7813 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.671357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24ad0-c167-45c8-ad92-0aea53fd7813 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.672168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a24ad0-c167-45c8-ad92-0aea53fd7813 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:37.672471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a24ad0-c167-45c8-ad92-0aea53fd7813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:37.673936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a24ad0-c167-45c8-ad92-0aea53fd7813 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:37.675705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b07212-eaa8-4853-b4b0-167db0054b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.676336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b07212-eaa8-4853-b4b0-167db0054b93 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.676615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b07212-eaa8-4853-b4b0-167db0054b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.676884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b07212-eaa8-4853-b4b0-167db0054b93 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.677674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b07212-eaa8-4853-b4b0-167db0054b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:37.677980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b07212-eaa8-4853-b4b0-167db0054b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:37.679405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b07212-eaa8-4853-b4b0-167db0054b93 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:37.691591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 334/657] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:37.692419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b07212-eaa8-4853-b4b0-167db0054b93 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.693400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 324/658] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:37.694412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24ad0-c167-45c8-ad92-0aea53fd7813 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.757092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:37.794450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b07212-eaa8-4853-b4b0-167db0054b93 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.794796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24ad0-c167-45c8-ad92-0aea53fd7813 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.828744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc878b1-9c2b-488b-adda-761ffa678e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.829419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94412812-1a16-48f7-8c6e-3ba1d79087db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.829538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc878b1-9c2b-488b-adda-761ffa678e19 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.829698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc878b1-9c2b-488b-adda-761ffa678e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.829972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc878b1-9c2b-488b-adda-761ffa678e19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.830064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94412812-1a16-48f7-8c6e-3ba1d79087db None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.830343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94412812-1a16-48f7-8c6e-3ba1d79087db None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.830616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94412812-1a16-48f7-8c6e-3ba1d79087db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:37.831954 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:37.837347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc878b1-9c2b-488b-adda-761ffa678e19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:37.839208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc878b1-9c2b-488b-adda-761ffa678e19 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:37.841777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94412812-1a16-48f7-8c6e-3ba1d79087db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-94412812-1a16-48f7-8c6e-3ba1d79087db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:37.847178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:37.848155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:37.849064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 335/659] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:37.850189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94412812-1a16-48f7-8c6e-3ba1d79087db None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4fc878b1-9c2b-488b-adda-761ffa678e19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:37.851218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:37.857347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 325/660] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:37.858518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc878b1-9c2b-488b-adda-761ffa678e19 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:37.959687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc878b1-9c2b-488b-adda-761ffa678e19 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.960551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94412812-1a16-48f7-8c6e-3ba1d79087db None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:37.985672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:37.996958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a98e6-d0ce-403e-9e3f-15ad27b3623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:37.997660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a98e6-d0ce-403e-9e3f-15ad27b3623c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:37.997941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a98e6-d0ce-403e-9e3f-15ad27b3623c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:37.998210 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a98e6-d0ce-403e-9e3f-15ad27b3623c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.008677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a98e6-d0ce-403e-9e3f-15ad27b3623c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.010199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a98e6-d0ce-403e-9e3f-15ad27b3623c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.015428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27581-eba8-47ce-92e1-f12d751d8a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.016486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27581-eba8-47ce-92e1-f12d751d8a80 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.016953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27581-eba8-47ce-92e1-f12d751d8a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.017491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27581-eba8-47ce-92e1-f12d751d8a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-fc2a98e6-d0ce-403e-9e3f-15ad27b3623c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:38.025137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:38.026108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:38.027042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:38.027042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:38.027042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:38.027042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:38.027042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 336/661] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:38.027616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a98e6-d0ce-403e-9e3f-15ad27b3623c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.106929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:38.115356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27581-eba8-47ce-92e1-f12d751d8a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.116848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27581-eba8-47ce-92e1-f12d751d8a80 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.129403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a98e6-d0ce-403e-9e3f-15ad27b3623c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:38.163661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a9d65-40d1-45d0-b691-76f49bb185e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.164289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a9d65-40d1-45d0-b691-76f49bb185e1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.164568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a9d65-40d1-45d0-b691-76f49bb185e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.164838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a9d65-40d1-45d0-b691-76f49bb185e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.165670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a9d65-40d1-45d0-b691-76f49bb185e1 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=2ecb8054ea4249d18903b5998fa753d6) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:38.166017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a9d65-40d1-45d0-b691-76f49bb185e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.167451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a9d65-40d1-45d0-b691-76f49bb185e1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.173905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 337/662] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/role_assignments?user.id=2ecb8054ea4249d18903b5998fa753d6&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:38.174692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a9d65-40d1-45d0-b691-76f49bb185e1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.227309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 326/663] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:38.227309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27581-eba8-47ce-92e1-f12d751d8a80 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.228186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:38.303734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a9d65-40d1-45d0-b691-76f49bb185e1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:38.335198 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:38.346980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27581-eba8-47ce-92e1-f12d751d8a80 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:38.348929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd38e-ae38-4b3c-a35d-2f702d0c9bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.349405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd38e-ae38-4b3c-a35d-2f702d0c9bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.349682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd38e-ae38-4b3c-a35d-2f702d0c9bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.349966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd38e-ae38-4b3c-a35d-2f702d0c9bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.350786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd38e-ae38-4b3c-a35d-2f702d0c9bb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:38.351043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd38e-ae38-4b3c-a35d-2f702d0c9bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.352498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd38e-ae38-4b3c-a35d-2f702d0c9bb2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.362705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 338/664] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:38.363615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd38e-ae38-4b3c-a35d-2f702d0c9bb2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.391154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fed79-ea51-445e-8cbe-c9e2100e7182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.391807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fed79-ea51-445e-8cbe-c9e2100e7182 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.392088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fed79-ea51-445e-8cbe-c9e2100e7182 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.392360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fed79-ea51-445e-8cbe-c9e2100e7182 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.393142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fed79-ea51-445e-8cbe-c9e2100e7182 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:38.393508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fed79-ea51-445e-8cbe-c9e2100e7182 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.395041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fed79-ea51-445e-8cbe-c9e2100e7182 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.408867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 327/665] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:38.409977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fed79-ea51-445e-8cbe-c9e2100e7182 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.488385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd38e-ae38-4b3c-a35d-2f702d0c9bb2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:38.490386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:38.527769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75d8ee-be9e-4972-8a7c-8402348e55ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.528718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75d8ee-be9e-4972-8a7c-8402348e55ad None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.529170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75d8ee-be9e-4972-8a7c-8402348e55ad None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.529472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75d8ee-be9e-4972-8a7c-8402348e55ad None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.530191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75d8ee-be9e-4972-8a7c-8402348e55ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:38.530509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75d8ee-be9e-4972-8a7c-8402348e55ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.530682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fed79-ea51-445e-8cbe-c9e2100e7182 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:38.531940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75d8ee-be9e-4972-8a7c-8402348e55ad None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.545903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 339/666] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:38.547142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75d8ee-be9e-4972-8a7c-8402348e55ad None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.575764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec0a66-5156-4150-8ed1-2b1d6fb72a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.576865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0a66-5156-4150-8ed1-2b1d6fb72a24 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.577438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0a66-5156-4150-8ed1-2b1d6fb72a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.577739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0a66-5156-4150-8ed1-2b1d6fb72a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.590309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec0a66-5156-4150-8ed1-2b1d6fb72a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.591181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec0a66-5156-4150-8ed1-2b1d6fb72a24 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-eaec0a66-5156-4150-8ed1-2b1d6fb72a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:38.608160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:38.609179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:38.611047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:38.611047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:38.611047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:38.611047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:38.611047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 328/667] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:38.611047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec0a66-5156-4150-8ed1-2b1d6fb72a24 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.622237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:38.678826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75d8ee-be9e-4972-8a7c-8402348e55ad None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:38.722894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec0a66-5156-4150-8ed1-2b1d6fb72a24 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:38.738801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73884e9-53df-4aab-865b-ac9351714dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.739873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73884e9-53df-4aab-865b-ac9351714dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.740444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73884e9-53df-4aab-865b-ac9351714dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.740830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73884e9-53df-4aab-865b-ac9351714dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.756545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73884e9-53df-4aab-865b-ac9351714dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.758028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73884e9-53df-4aab-865b-ac9351714dd3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.759035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a948f45-a92f-48c7-a35a-ffc465b4dae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.759688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a948f45-a92f-48c7-a35a-ffc465b4dae7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.759966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a948f45-a92f-48c7-a35a-ffc465b4dae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.760242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a948f45-a92f-48c7-a35a-ffc465b4dae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.761047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a948f45-a92f-48c7-a35a-ffc465b4dae7 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=c70a0ca34a3940d1b067430c9c2dc64e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:38.761469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a948f45-a92f-48c7-a35a-ffc465b4dae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.762918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a948f45-a92f-48c7-a35a-ffc465b4dae7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.770031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 329/668] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/role_assignments?user.id=c70a0ca34a3940d1b067430c9c2dc64e&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:38.770879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a948f45-a92f-48c7-a35a-ffc465b4dae7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e73884e9-53df-4aab-865b-ac9351714dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:38.775137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:38.776109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:38.777022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:38.777022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:38.777022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:38.777022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:38.777022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 340/669] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:38.777557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73884e9-53df-4aab-865b-ac9351714dd3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.795835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:38.854360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:38.899313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a948f45-a92f-48c7-a35a-ffc465b4dae7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:38.920397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73884e9-53df-4aab-865b-ac9351714dd3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:38.942718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90c1a8-a446-4d25-8506-e19cd716e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.943571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c1a8-a446-4d25-8506-e19cd716e6fa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.943952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c1a8-a446-4d25-8506-e19cd716e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.944322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c1a8-a446-4d25-8506-e19cd716e6fa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.956808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90c1a8-a446-4d25-8506-e19cd716e6fa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.959385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90c1a8-a446-4d25-8506-e19cd716e6fa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.962934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1391-d76a-462b-b5bb-e8a138c40475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:38.963599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1391-d76a-462b-b5bb-e8a138c40475 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:38.963876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1391-d76a-462b-b5bb-e8a138c40475 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:38.964140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1391-d76a-462b-b5bb-e8a138c40475 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:38.964845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1391-d76a-462b-b5bb-e8a138c40475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:38.965140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1391-d76a-462b-b5bb-e8a138c40475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:38.966571 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1391-d76a-462b-b5bb-e8a138c40475 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-fc90c1a8-a446-4d25-8506-e19cd716e6fa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:38.975710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:38.976904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:38.978023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 330/670] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:38.978784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90c1a8-a446-4d25-8506-e19cd716e6fa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:38.986179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 341/671] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:38.987364 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1391-d76a-462b-b5bb-e8a138c40475 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:39.073158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:39.095377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1391-d76a-462b-b5bb-e8a138c40475 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:39.096298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90c1a8-a446-4d25-8506-e19cd716e6fa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:39.126606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:39.130616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974315fd-c22a-4ce2-8e51-40cbca73a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:39.131260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974315fd-c22a-4ce2-8e51-40cbca73a189 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:39.131560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974315fd-c22a-4ce2-8e51-40cbca73a189 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:39.131814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974315fd-c22a-4ce2-8e51-40cbca73a189 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:39.132826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974315fd-c22a-4ce2-8e51-40cbca73a189 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:39.133145 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974315fd-c22a-4ce2-8e51-40cbca73a189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:39.134463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876027c9-7154-44e2-8bb4-278d94964e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:39.134691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974315fd-c22a-4ce2-8e51-40cbca73a189 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:39.135495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876027c9-7154-44e2-8bb4-278d94964e8c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:39.136126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876027c9-7154-44e2-8bb4-278d94964e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:39.136544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876027c9-7154-44e2-8bb4-278d94964e8c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:39.137437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876027c9-7154-44e2-8bb4-278d94964e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:39.137885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876027c9-7154-44e2-8bb4-278d94964e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:39.139407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876027c9-7154-44e2-8bb4-278d94964e8c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:39.153743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 331/672] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:39.154779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 342/673] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jul 26 07:14:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:39.155020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876027c9-7154-44e2-8bb4-278d94964e8c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:39.161991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974315fd-c22a-4ce2-8e51-40cbca73a189 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:39.261786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974315fd-c22a-4ce2-8e51-40cbca73a189 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:39.268506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876027c9-7154-44e2-8bb4-278d94964e8c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:39.291766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:39.297226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa4aff-fab4-471d-931e-e90f7b257d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:39.298106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa4aff-fab4-471d-931e-e90f7b257d0a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:39.298240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa4aff-fab4-471d-931e-e90f7b257d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:39.298440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa4aff-fab4-471d-931e-e90f7b257d0a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:39.306064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa4aff-fab4-471d-931e-e90f7b257d0a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:39.307585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa4aff-fab4-471d-931e-e90f7b257d0a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:39.311468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acf941-c473-40e9-8f4b-193c79efd29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:39.312127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acf941-c473-40e9-8f4b-193c79efd29e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:39.312403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acf941-c473-40e9-8f4b-193c79efd29e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:39.312671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acf941-c473-40e9-8f4b-193c79efd29e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:39.324587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acf941-c473-40e9-8f4b-193c79efd29e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f9fa4aff-fab4-471d-931e-e90f7b257d0a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:39.324758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:39.325764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:39.326722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:39.329292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acf941-c473-40e9-8f4b-193c79efd29e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:39.330621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 343/674] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:39.331514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa4aff-fab4-471d-931e-e90f7b257d0a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-56acf941-c473-40e9-8f4b-193c79efd29e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:39.345619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:39.346594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:39.347672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:39.347672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:39.347672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:39.347672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:39.347672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:39.347672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:39.347672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:39.347672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:39.355226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 332/675] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:39.355226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acf941-c473-40e9-8f4b-193c79efd29e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:39.411003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:39.448016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa4aff-fab4-471d-931e-e90f7b257d0a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:39.463757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acf941-c473-40e9-8f4b-193c79efd29e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:39.483814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15295219-2659-4207-98d0-ab916b2f974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:39.484793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15295219-2659-4207-98d0-ab916b2f974b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:39.485333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15295219-2659-4207-98d0-ab916b2f974b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:39.485800 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15295219-2659-4207-98d0-ab916b2f974b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:39.500116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e435-995a-427d-ba39-42d278a9785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:39.500742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e435-995a-427d-ba39-42d278a9785b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:39.501017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e435-995a-427d-ba39-42d278a9785b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:39.501303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e435-995a-427d-ba39-42d278a9785b None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:39.502110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e435-995a-427d-ba39-42d278a9785b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:39.502412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e435-995a-427d-ba39-42d278a9785b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:39.504027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e435-995a-427d-ba39-42d278a9785b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:39.526609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 333/676] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 26 07:14:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:39.527549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e435-995a-427d-ba39-42d278a9785b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:39.549591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:39.560384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15295219-2659-4207-98d0-ab916b2f974b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:39.562406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15295219-2659-4207-98d0-ab916b2f974b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:39.645246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e435-995a-427d-ba39-42d278a9785b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:39.656143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:39.679035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 344/677] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:39.680186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15295219-2659-4207-98d0-ab916b2f974b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:39.688746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c0085-84f6-4dd6-80e3-b9ad488b44a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:39.689420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0085-84f6-4dd6-80e3-b9ad488b44a1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:39.689709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0085-84f6-4dd6-80e3-b9ad488b44a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:39.689970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0085-84f6-4dd6-80e3-b9ad488b44a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:39.690785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c0085-84f6-4dd6-80e3-b9ad488b44a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:39.691087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c0085-84f6-4dd6-80e3-b9ad488b44a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:39.692527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c0085-84f6-4dd6-80e3-b9ad488b44a1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:39.713554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 334/678] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:39.714470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c0085-84f6-4dd6-80e3-b9ad488b44a1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:39.776770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:39.786247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15295219-2659-4207-98d0-ab916b2f974b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:39.817950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c0085-84f6-4dd6-80e3-b9ad488b44a1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:39.822180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4ebdf-6845-4ca5-a7d0-da0cc2b0778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:39.823042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4ebdf-6845-4ca5-a7d0-da0cc2b0778c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:39.823518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4ebdf-6845-4ca5-a7d0-da0cc2b0778c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:39.823988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4ebdf-6845-4ca5-a7d0-da0cc2b0778c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:39.852814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa880b-3bcb-4e67-924c-779ad037ff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:39.853526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa880b-3bcb-4e67-924c-779ad037ff09 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:39.853788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa880b-3bcb-4e67-924c-779ad037ff09 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:39.854057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa880b-3bcb-4e67-924c-779ad037ff09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:39.865487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa880b-3bcb-4e67-924c-779ad037ff09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:39.866953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa880b-3bcb-4e67-924c-779ad037ff09 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-95fa880b-3bcb-4e67-924c-779ad037ff09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:39.882284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:39.883254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:39.884202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:39.884202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:39.884202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:39.884202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:39.888062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 335/679] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:39.889033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa880b-3bcb-4e67-924c-779ad037ff09 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:39.902228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4ebdf-6845-4ca5-a7d0-da0cc2b0778c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:39.904017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4ebdf-6845-4ca5-a7d0-da0cc2b0778c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:39.914037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:40.001248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa880b-3bcb-4e67-924c-779ad037ff09 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:40.002229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:40.013146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 345/680] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:40.014435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4ebdf-6845-4ca5-a7d0-da0cc2b0778c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:40.045221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a7573-05a2-4483-a391-70a2f7f16b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:40.045947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a7573-05a2-4483-a391-70a2f7f16b23 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.046174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a7573-05a2-4483-a391-70a2f7f16b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.046444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a7573-05a2-4483-a391-70a2f7f16b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.047298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a7573-05a2-4483-a391-70a2f7f16b23 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=59f6195586c7434ab85604181ec2a076) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:40.047563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a7573-05a2-4483-a391-70a2f7f16b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:40.049082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a7573-05a2-4483-a391-70a2f7f16b23 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:40.061584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 336/681] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:39 2022] GET /identity/v3/role_assignments?user.id=59f6195586c7434ab85604181ec2a076&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:40.062875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a7573-05a2-4483-a391-70a2f7f16b23 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:40.127365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4ebdf-6845-4ca5-a7d0-da0cc2b0778c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:40.165830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176c68-7a9f-4362-9e39-a1fc3ecbb87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:40.166876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176c68-7a9f-4362-9e39-a1fc3ecbb87c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.167347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176c68-7a9f-4362-9e39-a1fc3ecbb87c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.167831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176c68-7a9f-4362-9e39-a1fc3ecbb87c None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.168724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29176c68-7a9f-4362-9e39-a1fc3ecbb87c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:40.169229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29176c68-7a9f-4362-9e39-a1fc3ecbb87c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:40.170834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29176c68-7a9f-4362-9e39-a1fc3ecbb87c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:40.184433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 346/682] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:40.190322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176c68-7a9f-4362-9e39-a1fc3ecbb87c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:40.216029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:40.251490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:40.254165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a7573-05a2-4483-a391-70a2f7f16b23 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:40.300701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34f2b6-03c0-4850-9385-2e226b5ab4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:40.301411 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34f2b6-03c0-4850-9385-2e226b5ab4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.301693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34f2b6-03c0-4850-9385-2e226b5ab4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.301966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34f2b6-03c0-4850-9385-2e226b5ab4e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.307427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176c68-7a9f-4362-9e39-a1fc3ecbb87c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:40.313854 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34f2b6-03c0-4850-9385-2e226b5ab4e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:40.315344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34f2b6-03c0-4850-9385-2e226b5ab4e4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2b34f2b6-03c0-4850-9385-2e226b5ab4e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:40.331557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:40.332549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:40.333502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:40.333502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:40.333502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:40.333502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:40.333502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 337/683] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:40.334521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bb537-d9a5-4a91-89c7-d18161208882 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.334859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bb537-d9a5-4a91-89c7-d18161208882 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.335133 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bb537-d9a5-4a91-89c7-d18161208882 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.340628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 338/684] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:40.341816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bb537-d9a5-4a91-89c7-d18161208882 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:40.351897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46d017-e0b0-4e09-9257-b9e1f65f1767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:40.352939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46d017-e0b0-4e09-9257-b9e1f65f1767 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.353510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46d017-e0b0-4e09-9257-b9e1f65f1767 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.353980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46d017-e0b0-4e09-9257-b9e1f65f1767 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.361995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46d017-e0b0-4e09-9257-b9e1f65f1767 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:40.363974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46d017-e0b0-4e09-9257-b9e1f65f1767 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3f46d017-e0b0-4e09-9257-b9e1f65f1767 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:40.376625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:40.377672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:40.378662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:40.378662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:40.378662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:40.378662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:40.378662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:40.378662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:40.378662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:40.378662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:40.379733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 347/685] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:40.382527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb5a74-6dfe-4c43-8a95-3d28d5819156 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.382808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb5a74-6dfe-4c43-8a95-3d28d5819156 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.383080 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb5a74-6dfe-4c43-8a95-3d28d5819156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.408994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-04eb5a74-6dfe-4c43-8a95-3d28d5819156 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:40.410716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-04eb5a74-6dfe-4c43-8a95-3d28d5819156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:40.469366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bb537-d9a5-4a91-89c7-d18161208882 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:40.497418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 348/686] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:40.498501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb5a74-6dfe-4c43-8a95-3d28d5819156 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:40.514035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788e52-3b0b-43af-89a4-e515389016eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:40.515101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788e52-3b0b-43af-89a4-e515389016eb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.516187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788e52-3b0b-43af-89a4-e515389016eb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.516711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788e52-3b0b-43af-89a4-e515389016eb None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.518028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba788e52-3b0b-43af-89a4-e515389016eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:40.518649 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba788e52-3b0b-43af-89a4-e515389016eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:40.520312 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba788e52-3b0b-43af-89a4-e515389016eb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:40.529036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:40.540935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 339/687] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:40.542338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788e52-3b0b-43af-89a4-e515389016eb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:40.569643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:40.621666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb5a74-6dfe-4c43-8a95-3d28d5819156 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:40.658667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacf055-478a-4191-bdd9-fd4113f6d49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:40.659428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf055-478a-4191-bdd9-fd4113f6d49a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.659708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf055-478a-4191-bdd9-fd4113f6d49a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.659981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf055-478a-4191-bdd9-fd4113f6d49a None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.660796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacf055-478a-4191-bdd9-fd4113f6d49a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:40.661111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacf055-478a-4191-bdd9-fd4113f6d49a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:40.662644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacf055-478a-4191-bdd9-fd4113f6d49a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:40.680157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 349/688] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:40.681131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacf055-478a-4191-bdd9-fd4113f6d49a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:40.684320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788e52-3b0b-43af-89a4-e515389016eb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:40.801548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacf055-478a-4191-bdd9-fd4113f6d49a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:40.805701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:40.843524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b94373-41f9-4cd8-8e10-c45a7e7e7a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:40.844499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b94373-41f9-4cd8-8e10-c45a7e7e7a73 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.844974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b94373-41f9-4cd8-8e10-c45a7e7e7a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.845447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b94373-41f9-4cd8-8e10-c45a7e7e7a73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.856662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b94373-41f9-4cd8-8e10-c45a7e7e7a73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:40.858791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b94373-41f9-4cd8-8e10-c45a7e7e7a73 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:40.860361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde457b-2b68-4379-ac1c-3c44d72da6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:40.861027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde457b-2b68-4379-ac1c-3c44d72da6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:40.861393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde457b-2b68-4379-ac1c-3c44d72da6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:40.861609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde457b-2b68-4379-ac1c-3c44d72da6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:40.873004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde457b-2b68-4379-ac1c-3c44d72da6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:40.874506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde457b-2b68-4379-ac1c-3c44d72da6d2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-59b94373-41f9-4cd8-8e10-c45a7e7e7a73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:40.875631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:40.876529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:40.877517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:40.877517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:40.877517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:40.877517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:40.877517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:40.877517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:40.877517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:40.877517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:40.883577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 350/689] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:40.883577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b94373-41f9-4cd8-8e10-c45a7e7e7a73 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2fde457b-2b68-4379-ac1c-3c44d72da6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:40.901178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:40.902179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:40.903088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:40.903088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:40.903088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:40.903088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:40.905507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 340/690] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:40.906533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde457b-2b68-4379-ac1c-3c44d72da6d2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:40.973568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:41.008694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b94373-41f9-4cd8-8e10-c45a7e7e7a73 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:41.033774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde457b-2b68-4379-ac1c-3c44d72da6d2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:41.047262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c26e29-3664-486c-81aa-3f3d40cef780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:41.047987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26e29-3664-486c-81aa-3f3d40cef780 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.048269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26e29-3664-486c-81aa-3f3d40cef780 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.048628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26e29-3664-486c-81aa-3f3d40cef780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.049477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c26e29-3664-486c-81aa-3f3d40cef780 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=7eab2497edff4c968030b5b0d6814150) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:41.049825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c26e29-3664-486c-81aa-3f3d40cef780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:41.051473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c26e29-3664-486c-81aa-3f3d40cef780 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:41.065607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 351/691] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:40 2022] GET /identity/v3/role_assignments?user.id=7eab2497edff4c968030b5b0d6814150&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:41.065607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c26e29-3664-486c-81aa-3f3d40cef780 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:41.079121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2318f-ac1f-48df-a917-4ebc27c6a94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:41.079881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2318f-ac1f-48df-a917-4ebc27c6a94d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.080164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2318f-ac1f-48df-a917-4ebc27c6a94d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.080438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2318f-ac1f-48df-a917-4ebc27c6a94d None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.081307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2318f-ac1f-48df-a917-4ebc27c6a94d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:41.081622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2318f-ac1f-48df-a917-4ebc27c6a94d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:41.083104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2318f-ac1f-48df-a917-4ebc27c6a94d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:41.100652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 341/692] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:41.101438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:41.102734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217256-8a64-41ca-90fd-407cdb931cb0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.103693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217256-8a64-41ca-90fd-407cdb931cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.104352 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217256-8a64-41ca-90fd-407cdb931cb0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.110195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 342/693] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:41.110868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217256-8a64-41ca-90fd-407cdb931cb0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:41.212405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c26e29-3664-486c-81aa-3f3d40cef780 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:41.251708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217256-8a64-41ca-90fd-407cdb931cb0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:41.257350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7758c1b-56dd-4894-a25a-3021754d34d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:41.258324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7758c1b-56dd-4894-a25a-3021754d34d6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.258817 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7758c1b-56dd-4894-a25a-3021754d34d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.259301 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7758c1b-56dd-4894-a25a-3021754d34d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.260095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7758c1b-56dd-4894-a25a-3021754d34d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:41.260472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7758c1b-56dd-4894-a25a-3021754d34d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:41.261986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7758c1b-56dd-4894-a25a-3021754d34d6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:41.262357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:41.278399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 352/694] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:41.279816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1a2a7-3da7-4e2c-a907-4b39c3039b96 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.280106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1a2a7-3da7-4e2c-a907-4b39c3039b96 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.280380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1a2a7-3da7-4e2c-a907-4b39c3039b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.300639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-59c1a2a7-3da7-4e2c-a907-4b39c3039b96 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:41.302230 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208817-8d67-47a5-a10f-922ca844ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:41.302387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-59c1a2a7-3da7-4e2c-a907-4b39c3039b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:41.302890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208817-8d67-47a5-a10f-922ca844ad64 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.303171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208817-8d67-47a5-a10f-922ca844ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.303444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208817-8d67-47a5-a10f-922ca844ad64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.304248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07208817-8d67-47a5-a10f-922ca844ad64 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=b5a03e5f2dee4bdeac26236d8127588c) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:41.304533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07208817-8d67-47a5-a10f-922ca844ad64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:41.307382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07208817-8d67-47a5-a10f-922ca844ad64 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:41.315795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 343/695] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:41 2022] GET /identity/v3/role_assignments?user.id=b5a03e5f2dee4bdeac26236d8127588c&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:41.317316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208817-8d67-47a5-a10f-922ca844ad64 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:41.389198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 353/696] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:41.412407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1a2a7-3da7-4e2c-a907-4b39c3039b96 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:41.436853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:41.444049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208817-8d67-47a5-a10f-922ca844ad64 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:41.481978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d715d8b-be16-415d-88d7-ba7b49236847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:41.482617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715d8b-be16-415d-88d7-ba7b49236847 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.482894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715d8b-be16-415d-88d7-ba7b49236847 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.483163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715d8b-be16-415d-88d7-ba7b49236847 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.483912 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d715d8b-be16-415d-88d7-ba7b49236847 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:41.485526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d715d8b-be16-415d-88d7-ba7b49236847 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:41.521296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 344/697] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:14:41 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:14:41.546236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1a2a7-3da7-4e2c-a907-4b39c3039b96 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:41.592418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97adbaf-8160-4293-b8f8-bfc3248b78d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:41.593532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97adbaf-8160-4293-b8f8-bfc3248b78d0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.593697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97adbaf-8160-4293-b8f8-bfc3248b78d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.593924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97adbaf-8160-4293-b8f8-bfc3248b78d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.608191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97adbaf-8160-4293-b8f8-bfc3248b78d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c97adbaf-8160-4293-b8f8-bfc3248b78d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:41.613480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:41.614519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:41.615383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 354/698] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:41.623683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d715d8b-be16-415d-88d7-ba7b49236847 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:41.656336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:41.745336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d715d8b-be16-415d-88d7-ba7b49236847 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:41.781469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0fdd5-f2b4-4a75-94d9-8c00d06acf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:41.782113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0fdd5-f2b4-4a75-94d9-8c00d06acf9e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.782385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0fdd5-f2b4-4a75-94d9-8c00d06acf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.782653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0fdd5-f2b4-4a75-94d9-8c00d06acf9e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.783386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0fdd5-f2b4-4a75-94d9-8c00d06acf9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:41.783683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0fdd5-f2b4-4a75-94d9-8c00d06acf9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:41.785106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0fdd5-f2b4-4a75-94d9-8c00d06acf9e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:41.794721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 345/699] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:41.800754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97adbaf-8160-4293-b8f8-bfc3248b78d0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:41.896216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:41.925790 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97adbaf-8160-4293-b8f8-bfc3248b78d0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:41.966925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22276b8b-de6f-4ff2-8f11-495924678637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:41.967602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276b8b-de6f-4ff2-8f11-495924678637 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:41.968244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276b8b-de6f-4ff2-8f11-495924678637 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:41.968516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276b8b-de6f-4ff2-8f11-495924678637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:41.984408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22276b8b-de6f-4ff2-8f11-495924678637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:41.985987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22276b8b-de6f-4ff2-8f11-495924678637 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-22276b8b-de6f-4ff2-8f11-495924678637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:42.010683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:42.011667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:42.012577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:42.012577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:42.012577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:42.012577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:42.014325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 355/700] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:42.019422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0fdd5-f2b4-4a75-94d9-8c00d06acf9e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:42.172536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:42.185201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0fdd5-f2b4-4a75-94d9-8c00d06acf9e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:42.236414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392fc11-09d4-43c8-85f3-df4cd5f1b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:42.237062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392fc11-09d4-43c8-85f3-df4cd5f1b94e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:42.237420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392fc11-09d4-43c8-85f3-df4cd5f1b94e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:42.237696 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392fc11-09d4-43c8-85f3-df4cd5f1b94e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:42.238411 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392fc11-09d4-43c8-85f3-df4cd5f1b94e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:42.238713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392fc11-09d4-43c8-85f3-df4cd5f1b94e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:42.240090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392fc11-09d4-43c8-85f3-df4cd5f1b94e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:42.260486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 346/701] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:42.266357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22276b8b-de6f-4ff2-8f11-495924678637 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:42.427874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22276b8b-de6f-4ff2-8f11-495924678637 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:42.454848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:42.463121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298508-fe43-49a1-90aa-052e55d56571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:42.464340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298508-fe43-49a1-90aa-052e55d56571 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:42.464894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298508-fe43-49a1-90aa-052e55d56571 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:42.465520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298508-fe43-49a1-90aa-052e55d56571 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:42.474857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74298508-fe43-49a1-90aa-052e55d56571 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:42.476323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74298508-fe43-49a1-90aa-052e55d56571 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-74298508-fe43-49a1-90aa-052e55d56571 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:42.488142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:42.489181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:42.490220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 356/702] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 26 07:14:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:42.502632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392fc11-09d4-43c8-85f3-df4cd5f1b94e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:42.520046 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7aa47-6a8f-41ab-b2ef-dc56c70e38a0 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:42.520304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7aa47-6a8f-41ab-b2ef-dc56c70e38a0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:42.520582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7aa47-6a8f-41ab-b2ef-dc56c70e38a0 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:42.522263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 357/703] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:14:42.527224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7c467-4550-4da0-8435-e52fef0fe705 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:42.527513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7c467-4550-4da0-8435-e52fef0fe705 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:42.527783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7c467-4550-4da0-8435-e52fef0fe705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:42.558992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-29d7c467-4550-4da0-8435-e52fef0fe705 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:42.560221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-29d7c467-4550-4da0-8435-e52fef0fe705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:42.697101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392fc11-09d4-43c8-85f3-df4cd5f1b94e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:42.715242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 358/704] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:42.737987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7c467-4550-4da0-8435-e52fef0fe705 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:42.763990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028294b-3617-40c4-97e9-bf402b9b276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:42.764616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028294b-3617-40c4-97e9-bf402b9b276a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:42.764888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028294b-3617-40c4-97e9-bf402b9b276a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:42.765155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028294b-3617-40c4-97e9-bf402b9b276a None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:42.770323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028294b-3617-40c4-97e9-bf402b9b276a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:42.770653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028294b-3617-40c4-97e9-bf402b9b276a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:42.772094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028294b-3617-40c4-97e9-bf402b9b276a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:42.796215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 347/705] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 26 07:14:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:42.802269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028294b-3617-40c4-97e9-bf402b9b276a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:42.817622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:42.879307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7c467-4550-4da0-8435-e52fef0fe705 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:42.914285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871688b-42bf-4972-8a80-710ea26ae7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:42.914972 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871688b-42bf-4972-8a80-710ea26ae7cb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:42.915270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871688b-42bf-4972-8a80-710ea26ae7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:42.915525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871688b-42bf-4972-8a80-710ea26ae7cb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:42.916193 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871688b-42bf-4972-8a80-710ea26ae7cb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:42.920467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:42.920467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871688b-42bf-4972-8a80-710ea26ae7cb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8871688b-42bf-4972-8a80-710ea26ae7cb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:42.933062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:42.934180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:42.935069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 359/706] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jul 26 07:14:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:42.946419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871688b-42bf-4972-8a80-710ea26ae7cb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:43.014308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028294b-3617-40c4-97e9-bf402b9b276a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:43.083406 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df90add-d7ea-4070-b755-27b91f60813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:43.085961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df90add-d7ea-4070-b755-27b91f60813e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:43.086450 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df90add-d7ea-4070-b755-27b91f60813e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:43.088374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df90add-d7ea-4070-b755-27b91f60813e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:43.163309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871688b-42bf-4972-8a80-710ea26ae7cb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:43.216841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df90add-d7ea-4070-b755-27b91f60813e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:43.219203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df90add-d7ea-4070-b755-27b91f60813e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:43.230410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:43.267498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cb046-b8c5-4562-9fee-b5f84dbbf930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:43.268059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb046-b8c5-4562-9fee-b5f84dbbf930 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:43.268337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb046-b8c5-4562-9fee-b5f84dbbf930 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:43.268688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb046-b8c5-4562-9fee-b5f84dbbf930 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:43.269417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb046-b8c5-4562-9fee-b5f84dbbf930 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:43.269722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb046-b8c5-4562-9fee-b5f84dbbf930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:43.271178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb046-b8c5-4562-9fee-b5f84dbbf930 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:43.291637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 360/707] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 26 07:14:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:43.302299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cb046-b8c5-4562-9fee-b5f84dbbf930 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:43.339416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 348/708] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:43.345093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df90add-d7ea-4070-b755-27b91f60813e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:43.410423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:43.481536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df90add-d7ea-4070-b755-27b91f60813e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:43.494195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:43.528920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8abeef-f8e5-4e0f-a2f5-7c16a059e255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:43.529965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8abeef-f8e5-4e0f-a2f5-7c16a059e255 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:43.530553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8abeef-f8e5-4e0f-a2f5-7c16a059e255 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:43.531038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8abeef-f8e5-4e0f-a2f5-7c16a059e255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:43.535874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cb046-b8c5-4562-9fee-b5f84dbbf930 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:43.552349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8abeef-f8e5-4e0f-a2f5-7c16a059e255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:43.554197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8abeef-f8e5-4e0f-a2f5-7c16a059e255 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:43.571128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb105-da27-451e-b4dd-9bcef824a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:43.576673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb105-da27-451e-b4dd-9bcef824a868 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:43.576673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb105-da27-451e-b4dd-9bcef824a868 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:43.576673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb105-da27-451e-b4dd-9bcef824a868 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:43.576673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bb105-da27-451e-b4dd-9bcef824a868 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:43.576673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bb105-da27-451e-b4dd-9bcef824a868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:43.576673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bb105-da27-451e-b4dd-9bcef824a868 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:43.581025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 361/709] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 26 07:14:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-be8abeef-f8e5-4e0f-a2f5-7c16a059e255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:43.584283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:43.585234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:43.586207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:43.586207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:43.586207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:43.586207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:43.588727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 349/710] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:43.595546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb105-da27-451e-b4dd-9bcef824a868 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:43.609326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924da8f-63c3-4b3f-82f8-76d999e581ee None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:43.609975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924da8f-63c3-4b3f-82f8-76d999e581ee None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:43.610453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924da8f-63c3-4b3f-82f8-76d999e581ee None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:43.612270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 350/711] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:14:43.618572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669245a7-a328-4819-9072-75f61a181d1c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:43.619205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669245a7-a328-4819-9072-75f61a181d1c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:43.619685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669245a7-a328-4819-9072-75f61a181d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:43.652204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-669245a7-a328-4819-9072-75f61a181d1c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:43.657439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-669245a7-a328-4819-9072-75f61a181d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:43.800696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb105-da27-451e-b4dd-9bcef824a868 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:43.805385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 351/712] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:14:43.813546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:43.825779 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669245a7-a328-4819-9072-75f61a181d1c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:43.847829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fee85-aed3-4013-9461-df96a019408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:43.848955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fee85-aed3-4013-9461-df96a019408c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:43.849753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fee85-aed3-4013-9461-df96a019408c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:43.850210 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fee85-aed3-4013-9461-df96a019408c None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:43.851109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fee85-aed3-4013-9461-df96a019408c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:43.851644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fee85-aed3-4013-9461-df96a019408c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:43.853797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fee85-aed3-4013-9461-df96a019408c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:43.871158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 362/713] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:43.876892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fee85-aed3-4013-9461-df96a019408c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:43.927557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:43.939502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669245a7-a328-4819-9072-75f61a181d1c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:43.977391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae216562-70d2-4114-a72f-50da0d737d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:43.978061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216562-70d2-4114-a72f-50da0d737d91 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:43.978341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216562-70d2-4114-a72f-50da0d737d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:43.978613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216562-70d2-4114-a72f-50da0d737d91 None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:43.979313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216562-70d2-4114-a72f-50da0d737d91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:43.980812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216562-70d2-4114-a72f-50da0d737d91 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:43.989152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fee85-aed3-4013-9461-df96a019408c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ae216562-70d2-4114-a72f-50da0d737d91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:43.992584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:43.993724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:14:43.994572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:43.997374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 352/714] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:43 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:43.999671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae216562-70d2-4114-a72f-50da0d737d91 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:44.032122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cec04d-3ae2-4bc0-9316-67dea13e6dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:44.033189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cec04d-3ae2-4bc0-9316-67dea13e6dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.033759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cec04d-3ae2-4bc0-9316-67dea13e6dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.034282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cec04d-3ae2-4bc0-9316-67dea13e6dc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.042555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cec04d-3ae2-4bc0-9316-67dea13e6dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:44.044406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cec04d-3ae2-4bc0-9316-67dea13e6dc1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e0cec04d-3ae2-4bc0-9316-67dea13e6dc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:44.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:44.058515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:44.059440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:44.059440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:44.059440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:44.059440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:44.059440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:44.059440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:44.059440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:44.059440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:44.061969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 363/715] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:44.068269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cec04d-3ae2-4bc0-9316-67dea13e6dc1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:44.102336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:44.169526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae216562-70d2-4114-a72f-50da0d737d91 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:44.184502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cec04d-3ae2-4bc0-9316-67dea13e6dc1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:44.204518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ffb79-c73f-4c42-abbb-9e463cc156f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:44.205159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ffb79-c73f-4c42-abbb-9e463cc156f2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.205464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ffb79-c73f-4c42-abbb-9e463cc156f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.205743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ffb79-c73f-4c42-abbb-9e463cc156f2 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.206497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ffb79-c73f-4c42-abbb-9e463cc156f2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:44.206799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ffb79-c73f-4c42-abbb-9e463cc156f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:44.208164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ffb79-c73f-4c42-abbb-9e463cc156f2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:44.212853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 353/716] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:14:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:44.213979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5678b8-c65f-491a-ac77-05799b385f2d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.214263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5678b8-c65f-491a-ac77-05799b385f2d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.214530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5678b8-c65f-491a-ac77-05799b385f2d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.215899 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 354/717] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:44.220283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690de7d9-5440-4385-bfbf-03951ed07eea None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.220564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690de7d9-5440-4385-bfbf-03951ed07eea None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.220835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690de7d9-5440-4385-bfbf-03951ed07eea None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.222330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 355/718] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:44.222899 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690de7d9-5440-4385-bfbf-03951ed07eea None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:44.231263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124b295-e20a-4786-889b-ac3526c79e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:44.231895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124b295-e20a-4786-889b-ac3526c79e36 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.232538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124b295-e20a-4786-889b-ac3526c79e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.232538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124b295-e20a-4786-889b-ac3526c79e36 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.233178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124b295-e20a-4786-889b-ac3526c79e36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:44.233507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124b295-e20a-4786-889b-ac3526c79e36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:44.234996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124b295-e20a-4786-889b-ac3526c79e36 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:44.245914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:44.251198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 364/719] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:44.252524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a78b26-b454-4483-b48e-0712009da511 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.252850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a78b26-b454-4483-b48e-0712009da511 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.253124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a78b26-b454-4483-b48e-0712009da511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.272108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f7a78b26-b454-4483-b48e-0712009da511 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:44.273351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f7a78b26-b454-4483-b48e-0712009da511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:44.336816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690de7d9-5440-4385-bfbf-03951ed07eea None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:44.344021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 365/720] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:44.345447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f74a4-11a7-432b-86f7-2c8ee401e0f0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.345731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f74a4-11a7-432b-86f7-2c8ee401e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.345997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f74a4-11a7-432b-86f7-2c8ee401e0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.364474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-159f74a4-11a7-432b-86f7-2c8ee401e0f0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:44.365749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-159f74a4-11a7-432b-86f7-2c8ee401e0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:44.382808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:44.387141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9023918-f781-44be-ab1c-9ffc0fb94627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:44.387797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9023918-f781-44be-ab1c-9ffc0fb94627 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.388073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9023918-f781-44be-ab1c-9ffc0fb94627 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.388342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9023918-f781-44be-ab1c-9ffc0fb94627 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.389049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9023918-f781-44be-ab1c-9ffc0fb94627 None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:44.389383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9023918-f781-44be-ab1c-9ffc0fb94627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:44.390833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9023918-f781-44be-ab1c-9ffc0fb94627 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:44.397516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 356/721] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:14:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:44.398569 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9023918-f781-44be-ab1c-9ffc0fb94627 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:44.473550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 366/722] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:44.474873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f74a4-11a7-432b-86f7-2c8ee401e0f0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:44.524794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:44.552401 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9023918-f781-44be-ab1c-9ffc0fb94627 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:44.599588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfaddc-b4ca-4d69-b1a8-28e52889ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:44.599807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfaddc-b4ca-4d69-b1a8-28e52889ee60 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.599973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfaddc-b4ca-4d69-b1a8-28e52889ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.600254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfaddc-b4ca-4d69-b1a8-28e52889ee60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.601066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfaddc-b4ca-4d69-b1a8-28e52889ee60 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=c70a0ca34a3940d1b067430c9c2dc64e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:44.601422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfaddc-b4ca-4d69-b1a8-28e52889ee60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:44.602880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfaddc-b4ca-4d69-b1a8-28e52889ee60 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:44.606570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f74a4-11a7-432b-86f7-2c8ee401e0f0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:44.608574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 357/723] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:44 2022] GET /identity/v3/role_assignments?user.id=c70a0ca34a3940d1b067430c9c2dc64e&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:44.609437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfaddc-b4ca-4d69-b1a8-28e52889ee60 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:44.662240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba0272-5984-4a3c-9c35-5297738f4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:44.663416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba0272-5984-4a3c-9c35-5297738f4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.663888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba0272-5984-4a3c-9c35-5297738f4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.664467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba0272-5984-4a3c-9c35-5297738f4cc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.688486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba0272-5984-4a3c-9c35-5297738f4cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f0ba0272-5984-4a3c-9c35-5297738f4cc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:44.694099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:44.695077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:44.695957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:44.701656 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 367/724] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:44.702729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba0272-5984-4a3c-9c35-5297738f4cc9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:44.727456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:44.736129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfaddc-b4ca-4d69-b1a8-28e52889ee60 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:44.778501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5111f-f296-49b9-ab0d-8da58f1cb674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:44.779851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5111f-f296-49b9-ab0d-8da58f1cb674 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.780358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5111f-f296-49b9-ab0d-8da58f1cb674 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.781930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5111f-f296-49b9-ab0d-8da58f1cb674 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.808437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5111f-f296-49b9-ab0d-8da58f1cb674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9ba5111f-f296-49b9-ab0d-8da58f1cb674 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:44.818634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:44.819680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:44.820643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 358/725] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:44.830485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5111f-f296-49b9-ab0d-8da58f1cb674 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:44.847291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:44.912456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba0272-5984-4a3c-9c35-5297738f4cc9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:44.953879 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c8273-7783-43da-8700-78a29b24ceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:44.954511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c8273-7783-43da-8700-78a29b24ceb9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:44.954786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c8273-7783-43da-8700-78a29b24ceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:44.955053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c8273-7783-43da-8700-78a29b24ceb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:44.955785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c8273-7783-43da-8700-78a29b24ceb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:44.956148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c8273-7783-43da-8700-78a29b24ceb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:44.957700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c8273-7783-43da-8700-78a29b24ceb9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:44.969713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5111f-f296-49b9-ab0d-8da58f1cb674 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:44.980788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 368/726] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:44.986315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c8273-7783-43da-8700-78a29b24ceb9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:45.026864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714783-a4b9-4fa2-bd14-00d3050b0fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:45.027518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714783-a4b9-4fa2-bd14-00d3050b0fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.027796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714783-a4b9-4fa2-bd14-00d3050b0fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.028071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714783-a4b9-4fa2-bd14-00d3050b0fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.028808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714783-a4b9-4fa2-bd14-00d3050b0fb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:45.029112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714783-a4b9-4fa2-bd14-00d3050b0fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:45.030519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714783-a4b9-4fa2-bd14-00d3050b0fb2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:45.045430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 359/727] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:45.052197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714783-a4b9-4fa2-bd14-00d3050b0fb2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:45.110595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:45.166345 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c8273-7783-43da-8700-78a29b24ceb9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:45.168264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:45.209016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714783-a4b9-4fa2-bd14-00d3050b0fb2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:45.247887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743950-b8c9-4cc4-ab84-e0dde16b78d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:45.248559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743950-b8c9-4cc4-ab84-e0dde16b78d2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.248834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743950-b8c9-4cc4-ab84-e0dde16b78d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.249111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743950-b8c9-4cc4-ab84-e0dde16b78d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.265147 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047436fd-f439-4937-b9c2-dc741211909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:45.265841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047436fd-f439-4937-b9c2-dc741211909a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.266116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047436fd-f439-4937-b9c2-dc741211909a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.266385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047436fd-f439-4937-b9c2-dc741211909a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.278866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09743950-b8c9-4cc4-ab84-e0dde16b78d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:45.280336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09743950-b8c9-4cc4-ab84-e0dde16b78d2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:45.291332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047436fd-f439-4937-b9c2-dc741211909a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:45.292824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047436fd-f439-4937-b9c2-dc741211909a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-09743950-b8c9-4cc4-ab84-e0dde16b78d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:45.305873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:45.306841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:45.307775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:45.307775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:45.307775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:45.307775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-047436fd-f439-4937-b9c2-dc741211909a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:45.313028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:45.314137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:45.315310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:45.315310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:45.315310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:45.315310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:45.315310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 369/728] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:45.318102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047436fd-f439-4937-b9c2-dc741211909a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:45.319940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 360/729] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:45.325224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743950-b8c9-4cc4-ab84-e0dde16b78d2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:45.465983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743950-b8c9-4cc4-ab84-e0dde16b78d2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:45.490410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:45.507590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15409a-32e7-482f-89dc-bd9dcd9eda24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:45.508375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15409a-32e7-482f-89dc-bd9dcd9eda24 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.508659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15409a-32e7-482f-89dc-bd9dcd9eda24 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.508932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15409a-32e7-482f-89dc-bd9dcd9eda24 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.509671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15409a-32e7-482f-89dc-bd9dcd9eda24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:45.509975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15409a-32e7-482f-89dc-bd9dcd9eda24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:45.511365 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15409a-32e7-482f-89dc-bd9dcd9eda24 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:45.525215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 361/730] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:45.530253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15409a-32e7-482f-89dc-bd9dcd9eda24 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:45.587257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047436fd-f439-4937-b9c2-dc741211909a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:45.638677 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15409a-32e7-482f-89dc-bd9dcd9eda24 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:45.671397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:45.689157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9740-e977-4af0-9f87-99acb8e79525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:45.689814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9740-e977-4af0-9f87-99acb8e79525 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.690095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9740-e977-4af0-9f87-99acb8e79525 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.690405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9740-e977-4af0-9f87-99acb8e79525 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.691119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9740-e977-4af0-9f87-99acb8e79525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:45.691421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9740-e977-4af0-9f87-99acb8e79525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:45.700051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9740-e977-4af0-9f87-99acb8e79525 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:45.706387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52859b3-ad70-44f9-acce-db6f1c077b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:45.707051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52859b3-ad70-44f9-acce-db6f1c077b79 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.707331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52859b3-ad70-44f9-acce-db6f1c077b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.707603 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52859b3-ad70-44f9-acce-db6f1c077b79 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.722688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52859b3-ad70-44f9-acce-db6f1c077b79 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:45.724056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52859b3-ad70-44f9-acce-db6f1c077b79 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:45.726485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 370/731] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:45.732060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9740-e977-4af0-9f87-99acb8e79525 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c52859b3-ad70-44f9-acce-db6f1c077b79 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:45.750778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:45.751820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:45.752872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 362/732] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:45.758272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52859b3-ad70-44f9-acce-db6f1c077b79 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:45.845692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:45.850152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9740-e977-4af0-9f87-99acb8e79525 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:45.886921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89284c-1f6c-4c18-a420-b59d38e48908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:45.887575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89284c-1f6c-4c18-a420-b59d38e48908 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.887854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89284c-1f6c-4c18-a420-b59d38e48908 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.888124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89284c-1f6c-4c18-a420-b59d38e48908 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.896042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89284c-1f6c-4c18-a420-b59d38e48908 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:45.897522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89284c-1f6c-4c18-a420-b59d38e48908 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3d89284c-1f6c-4c18-a420-b59d38e48908 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:45.910534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:45.911534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:14:45.913010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:45.913599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52859b3-ad70-44f9-acce-db6f1c077b79 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:45.913675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 371/733] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:14:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:45.913675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713767e-00f7-4d8b-aad0-d141171610d8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.918157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713767e-00f7-4d8b-aad0-d141171610d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.918469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713767e-00f7-4d8b-aad0-d141171610d8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.920102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 372/734] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:45.920834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713767e-00f7-4d8b-aad0-d141171610d8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:45.946890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5628b9-c6ae-40c0-a0d3-5a1fbb8aa7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:45.947519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5628b9-c6ae-40c0-a0d3-5a1fbb8aa7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.947800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5628b9-c6ae-40c0-a0d3-5a1fbb8aa7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.948073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5628b9-c6ae-40c0-a0d3-5a1fbb8aa7e3 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.948899 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5628b9-c6ae-40c0-a0d3-5a1fbb8aa7e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:45.949229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5628b9-c6ae-40c0-a0d3-5a1fbb8aa7e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:45.950999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5628b9-c6ae-40c0-a0d3-5a1fbb8aa7e3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:45.971031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 363/735] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 26 07:14:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:45.972496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb2f2a-4fd9-42d4-89cd-b3e5cc23d10a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:45.972902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb2f2a-4fd9-42d4-89cd-b3e5cc23d10a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:45.973125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb2f2a-4fd9-42d4-89cd-b3e5cc23d10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:45.977461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:45.992574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fdcb2f2a-4fd9-42d4-89cd-b3e5cc23d10a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:45.993954 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fdcb2f2a-4fd9-42d4-89cd-b3e5cc23d10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:46.064299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713767e-00f7-4d8b-aad0-d141171610d8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:46.072746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 364/736] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:46.073807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb2f2a-4fd9-42d4-89cd-b3e5cc23d10a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:46.108667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:46.112349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76208d6f-a005-4fe1-a2a1-85c43a365a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:46.113050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76208d6f-a005-4fe1-a2a1-85c43a365a88 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:46.113374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76208d6f-a005-4fe1-a2a1-85c43a365a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:46.113650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76208d6f-a005-4fe1-a2a1-85c43a365a88 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:46.115239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76208d6f-a005-4fe1-a2a1-85c43a365a88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:46.115552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76208d6f-a005-4fe1-a2a1-85c43a365a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:46.117035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76208d6f-a005-4fe1-a2a1-85c43a365a88 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:46.141399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 373/737] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 26 07:14:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:46.142400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76208d6f-a005-4fe1-a2a1-85c43a365a88 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:46.198618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb2f2a-4fd9-42d4-89cd-b3e5cc23d10a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:46.244265 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1b74d-0601-4bb0-bd53-a616575c2422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:46.244915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1b74d-0601-4bb0-bd53-a616575c2422 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:46.245143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1b74d-0601-4bb0-bd53-a616575c2422 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:46.245388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1b74d-0601-4bb0-bd53-a616575c2422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:46.263164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76208d6f-a005-4fe1-a2a1-85c43a365a88 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:46.265511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:46.305228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee668a-27e7-44c4-bee1-95dd47730e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:46.306334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee668a-27e7-44c4-bee1-95dd47730e20 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:46.306877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee668a-27e7-44c4-bee1-95dd47730e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:46.307339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee668a-27e7-44c4-bee1-95dd47730e20 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:46.308247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee668a-27e7-44c4-bee1-95dd47730e20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:46.310159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee668a-27e7-44c4-bee1-95dd47730e20 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:46.330611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1b74d-0601-4bb0-bd53-a616575c2422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:46.332141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1b74d-0601-4bb0-bd53-a616575c2422 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:46.334017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 374/738] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:14:46 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:14:46.335276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee668a-27e7-44c4-bee1-95dd47730e20 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:46.362555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:46.440416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 365/739] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:46.450477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1b74d-0601-4bb0-bd53-a616575c2422 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:46.466450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee668a-27e7-44c4-bee1-95dd47730e20 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:46.504288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8515e-26b1-45e8-9da2-5bb30ce094eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:46.505251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8515e-26b1-45e8-9da2-5bb30ce094eb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:46.505698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8515e-26b1-45e8-9da2-5bb30ce094eb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:46.506107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8515e-26b1-45e8-9da2-5bb30ce094eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:46.538631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:46.584505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8515e-26b1-45e8-9da2-5bb30ce094eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:46.595072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8515e-26b1-45e8-9da2-5bb30ce094eb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:46.650264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1b74d-0601-4bb0-bd53-a616575c2422 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:46.685719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:46.690031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bced0-b71c-4f21-89bd-2997b7369e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:46.691017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bced0-b71c-4f21-89bd-2997b7369e69 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:46.691498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bced0-b71c-4f21-89bd-2997b7369e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:46.691966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bced0-b71c-4f21-89bd-2997b7369e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:46.710349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bced0-b71c-4f21-89bd-2997b7369e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:46.712202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bced0-b71c-4f21-89bd-2997b7369e69 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:46.727797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 375/740] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:46 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2d5bced0-b71c-4f21-89bd-2997b7369e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:46.729741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:46.730641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:46.731548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:46.731548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:46.731548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:46.731548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:46.733791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 366/741] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:46.737891 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8515e-26b1-45e8-9da2-5bb30ce094eb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:46.739076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bced0-b71c-4f21-89bd-2997b7369e69 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:46.810551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:46.861295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8515e-26b1-45e8-9da2-5bb30ce094eb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:46.883172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bced0-b71c-4f21-89bd-2997b7369e69 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:46.924342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432f91b-6034-4e56-a674-5ccdf35c8e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:46.925249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432f91b-6034-4e56-a674-5ccdf35c8e53 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:46.925636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432f91b-6034-4e56-a674-5ccdf35c8e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:46.925907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432f91b-6034-4e56-a674-5ccdf35c8e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:46.927932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae6217-b8b2-4f30-88b8-78559babc36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:46.928841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae6217-b8b2-4f30-88b8-78559babc36e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:46.929591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae6217-b8b2-4f30-88b8-78559babc36e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:46.929871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae6217-b8b2-4f30-88b8-78559babc36e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:46.930592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae6217-b8b2-4f30-88b8-78559babc36e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:46.930900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae6217-b8b2-4f30-88b8-78559babc36e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:46.932596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae6217-b8b2-4f30-88b8-78559babc36e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:46.937864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432f91b-6034-4e56-a674-5ccdf35c8e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:46.939411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432f91b-6034-4e56-a674-5ccdf35c8e53 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:46.948366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 367/742] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:46.950353 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ac65-e63b-4580-9dc9-84fb2f9e370f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:46.950720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ac65-e63b-4580-9dc9-84fb2f9e370f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:46.950998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ac65-e63b-4580-9dc9-84fb2f9e370f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:46.952682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 368/743] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:46.958253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664ac65-e63b-4580-9dc9-84fb2f9e370f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a432f91b-6034-4e56-a674-5ccdf35c8e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:46.963986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:46.964952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:46.965936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:46.965936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:46.965936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:46.965936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:46.965936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 376/744] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:46.966830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33fe1-fb7e-4b77-be83-b662474571e1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:46.967108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33fe1-fb7e-4b77-be83-b662474571e1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:46.967374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33fe1-fb7e-4b77-be83-b662474571e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:46.988662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e2c33fe1-fb7e-4b77-be83-b662474571e1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:46.989909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e2c33fe1-fb7e-4b77-be83-b662474571e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:47.024946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:47.069555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 377/745] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:14:47.069555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33fe1-fb7e-4b77-be83-b662474571e1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:47.091018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664ac65-e63b-4580-9dc9-84fb2f9e370f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:47.119702 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:47.129081 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dea962-5b21-410c-8663-bbc6be17b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:47.130056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dea962-5b21-410c-8663-bbc6be17b729 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:47.130339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dea962-5b21-410c-8663-bbc6be17b729 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:47.130613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dea962-5b21-410c-8663-bbc6be17b729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:47.139878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dea962-5b21-410c-8663-bbc6be17b729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:47.142094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dea962-5b21-410c-8663-bbc6be17b729 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-25dea962-5b21-410c-8663-bbc6be17b729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:47.155819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:47.156888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 369/746] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:47.158200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0489d8-70b9-4e3d-9fa3-c85a8fe83e7c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:47.158790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0489d8-70b9-4e3d-9fa3-c85a8fe83e7c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:47.158790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0489d8-70b9-4e3d-9fa3-c85a8fe83e7c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:47.160389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 370/747] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:47.161084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0489d8-70b9-4e3d-9fa3-c85a8fe83e7c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:47.185337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33fe1-fb7e-4b77-be83-b662474571e1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:47.224613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f8731-8580-42e4-9bc8-3014c36be1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:47.225363 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f8731-8580-42e4-9bc8-3014c36be1af None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:47.225649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f8731-8580-42e4-9bc8-3014c36be1af None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:47.225915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f8731-8580-42e4-9bc8-3014c36be1af None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:47.226617 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f8731-8580-42e4-9bc8-3014c36be1af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:47.226917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f8731-8580-42e4-9bc8-3014c36be1af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:47.228421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f8731-8580-42e4-9bc8-3014c36be1af None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:47.245530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 378/748] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:47.246381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f8731-8580-42e4-9bc8-3014c36be1af None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:47.269823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:47.275253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0489d8-70b9-4e3d-9fa3-c85a8fe83e7c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:47.309436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99140a10-b6dd-428b-ac19-806beb684e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:47.310064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99140a10-b6dd-428b-ac19-806beb684e09 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:47.310340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99140a10-b6dd-428b-ac19-806beb684e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:47.310611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99140a10-b6dd-428b-ac19-806beb684e09 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:47.311306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99140a10-b6dd-428b-ac19-806beb684e09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:47.312669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99140a10-b6dd-428b-ac19-806beb684e09 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:47.329456 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 371/749] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:14:47 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:14:47.330888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f410362-4a50-4cbc-8746-fe369191e1a4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:47.331273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f410362-4a50-4cbc-8746-fe369191e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:47.331648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f410362-4a50-4cbc-8746-fe369191e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:47.355838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8f410362-4a50-4cbc-8746-fe369191e1a4 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:47.357360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8f410362-4a50-4cbc-8746-fe369191e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:47.362575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:47.366492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f8731-8580-42e4-9bc8-3014c36be1af None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:47.409750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2d16e-2af0-441a-8bef-f8bae88efe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:47.410756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2d16e-2af0-441a-8bef-f8bae88efe89 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:47.411185 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2d16e-2af0-441a-8bef-f8bae88efe89 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:47.411664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2d16e-2af0-441a-8bef-f8bae88efe89 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:47.412624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2d16e-2af0-441a-8bef-f8bae88efe89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:47.413116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2d16e-2af0-441a-8bef-f8bae88efe89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:47.414811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2d16e-2af0-441a-8bef-f8bae88efe89 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:47.433835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 379/750] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:47.435084 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2d16e-2af0-441a-8bef-f8bae88efe89 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:47.448728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 372/751] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:47.450092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f410362-4a50-4cbc-8746-fe369191e1a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:47.565815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:47.575405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2d16e-2af0-441a-8bef-f8bae88efe89 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:47.576998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f410362-4a50-4cbc-8746-fe369191e1a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:47.623901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd544-2038-4dd1-923a-5146a34382c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:47.624556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd544-2038-4dd1-923a-5146a34382c8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:47.624678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af933bc-e0ba-4f3a-8b23-c5932260b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:47.624876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd544-2038-4dd1-923a-5146a34382c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:47.625152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd544-2038-4dd1-923a-5146a34382c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:47.625252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af933bc-e0ba-4f3a-8b23-c5932260b772 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:47.625583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af933bc-e0ba-4f3a-8b23-c5932260b772 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:47.625858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af933bc-e0ba-4f3a-8b23-c5932260b772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:47.626021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bd544-2038-4dd1-923a-5146a34382c8 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=b5a03e5f2dee4bdeac26236d8127588c) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:47.626297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bd544-2038-4dd1-923a-5146a34382c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:47.628379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bd544-2038-4dd1-923a-5146a34382c8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:47.636291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 373/752] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:47 2022] GET /identity/v3/role_assignments?user.id=b5a03e5f2dee4bdeac26236d8127588c&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:47.637078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af933bc-e0ba-4f3a-8b23-c5932260b772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:47.637283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd544-2038-4dd1-923a-5146a34382c8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:47.638732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af933bc-e0ba-4f3a-8b23-c5932260b772 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2af933bc-e0ba-4f3a-8b23-c5932260b772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:47.655682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:47.656705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:47.657667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:47.657667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:47.657667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:47.657667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:47.657667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:47.657667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:47.657667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:47.657667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:47.658735 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 380/753] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:47.664873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af933bc-e0ba-4f3a-8b23-c5932260b772 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:47.704113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:47.841663 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd544-2038-4dd1-923a-5146a34382c8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:47.862867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af933bc-e0ba-4f3a-8b23-c5932260b772 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:47.926220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f56904-8b1c-448a-b5dd-b2838be6cea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:47.926832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f56904-8b1c-448a-b5dd-b2838be6cea2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:47.927117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f56904-8b1c-448a-b5dd-b2838be6cea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:47.927391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f56904-8b1c-448a-b5dd-b2838be6cea2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:47.957613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f56904-8b1c-448a-b5dd-b2838be6cea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d4f56904-8b1c-448a-b5dd-b2838be6cea2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:47.964519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:47.965443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:47.970076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 374/754] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:47.976163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f56904-8b1c-448a-b5dd-b2838be6cea2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:48.022684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:48.047791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b623b-682a-4c08-80b8-7085010df263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:48.049772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b623b-682a-4c08-80b8-7085010df263 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:48.050347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b623b-682a-4c08-80b8-7085010df263 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:48.050774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b623b-682a-4c08-80b8-7085010df263 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:48.051901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b623b-682a-4c08-80b8-7085010df263 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:48.052765 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b623b-682a-4c08-80b8-7085010df263 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:48.054734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b623b-682a-4c08-80b8-7085010df263 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:48.074903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 381/755] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:48.076706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b623b-682a-4c08-80b8-7085010df263 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:48.163058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:48.190126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b623b-682a-4c08-80b8-7085010df263 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:48.227286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7d6e1-10f2-4fde-a6ae-57206c6accda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:48.228315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7d6e1-10f2-4fde-a6ae-57206c6accda None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:48.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7d6e1-10f2-4fde-a6ae-57206c6accda None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:48.229252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7d6e1-10f2-4fde-a6ae-57206c6accda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:48.230284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7d6e1-10f2-4fde-a6ae-57206c6accda None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=53d237d0049541999d292b88d851e95a) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:48.230801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7d6e1-10f2-4fde-a6ae-57206c6accda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:48.232474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7d6e1-10f2-4fde-a6ae-57206c6accda None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:48.235605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f56904-8b1c-448a-b5dd-b2838be6cea2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:48.245407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 382/756] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:48 2022] GET /identity/v3/role_assignments?user.id=53d237d0049541999d292b88d851e95a&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:48.326278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d62eb-14a6-44bc-b662-4768d0c9dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:48.326998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d62eb-14a6-44bc-b662-4768d0c9dafc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:48.327279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d62eb-14a6-44bc-b662-4768d0c9dafc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:48.327564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d62eb-14a6-44bc-b662-4768d0c9dafc None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:48.328334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d62eb-14a6-44bc-b662-4768d0c9dafc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:48.328643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d62eb-14a6-44bc-b662-4768d0c9dafc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:48.330103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d62eb-14a6-44bc-b662-4768d0c9dafc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:48.340767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 375/757] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:48.347777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7d6e1-10f2-4fde-a6ae-57206c6accda None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:48.491639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7d6e1-10f2-4fde-a6ae-57206c6accda None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:48.528430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71be4f-17c4-4de7-a3ae-6cc46e6f4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:48.529515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71be4f-17c4-4de7-a3ae-6cc46e6f4e11 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:48.530100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71be4f-17c4-4de7-a3ae-6cc46e6f4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:48.530588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71be4f-17c4-4de7-a3ae-6cc46e6f4e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:48.540866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:48.544384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71be4f-17c4-4de7-a3ae-6cc46e6f4e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:48.547941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71be4f-17c4-4de7-a3ae-6cc46e6f4e11 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3d71be4f-17c4-4de7-a3ae-6cc46e6f4e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:48.564529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:48.565609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:48.566527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:48.566527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:48.566527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:48.566527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:48.568565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 383/758] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:48.574215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d62eb-14a6-44bc-b662-4768d0c9dafc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:48.715669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:48.749717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d62eb-14a6-44bc-b662-4768d0c9dafc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:48.796800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b3351-e349-44c4-834d-0f157ebd2aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:48.797465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b3351-e349-44c4-834d-0f157ebd2aac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:48.797744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b3351-e349-44c4-834d-0f157ebd2aac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:48.798021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b3351-e349-44c4-834d-0f157ebd2aac None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:48.798732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b3351-e349-44c4-834d-0f157ebd2aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:48.799030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b3351-e349-44c4-834d-0f157ebd2aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:48.800467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b3351-e349-44c4-834d-0f157ebd2aac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:48.818830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 376/759] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:48.823354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71be4f-17c4-4de7-a3ae-6cc46e6f4e11 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:48.945818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2e9a4-564c-43a5-9cc1-5db98fdb68ce None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:48.946148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2e9a4-564c-43a5-9cc1-5db98fdb68ce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:48.946372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2e9a4-564c-43a5-9cc1-5db98fdb68ce None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:48.948712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 377/760] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:48.956528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052e2dc-2e0a-431a-a11d-44802b22bb5f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:48.956826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052e2dc-2e0a-431a-a11d-44802b22bb5f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:48.957077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052e2dc-2e0a-431a-a11d-44802b22bb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:48.979199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c052e2dc-2e0a-431a-a11d-44802b22bb5f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:48.980951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c052e2dc-2e0a-431a-a11d-44802b22bb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:48.989347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71be4f-17c4-4de7-a3ae-6cc46e6f4e11 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:49.064031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb17ce-8efe-49be-8437-aaedd5140f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:49.068411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb17ce-8efe-49be-8437-aaedd5140f24 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:49.068939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb17ce-8efe-49be-8437-aaedd5140f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:49.069439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb17ce-8efe-49be-8437-aaedd5140f24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:49.082913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb17ce-8efe-49be-8437-aaedd5140f24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:49.084878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb17ce-8efe-49be-8437-aaedd5140f24 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-38bb17ce-8efe-49be-8437-aaedd5140f24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:49.104870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:49.105931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:49.106873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:49.107409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 378/761] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:14:49.109535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 384/762] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 26 07:14:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:49.117308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052e2dc-2e0a-431a-a11d-44802b22bb5f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:49.131911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb17ce-8efe-49be-8437-aaedd5140f24 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:49.193627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:49.229106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:49.245315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052e2dc-2e0a-431a-a11d-44802b22bb5f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:49.284077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb17ce-8efe-49be-8437-aaedd5140f24 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:49.310038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add6060-2a86-429e-8d5e-52dd3e0f167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:49.310695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add6060-2a86-429e-8d5e-52dd3e0f167f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:49.310981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add6060-2a86-429e-8d5e-52dd3e0f167f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:49.311261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add6060-2a86-429e-8d5e-52dd3e0f167f None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:49.312086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add6060-2a86-429e-8d5e-52dd3e0f167f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:49.312397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add6060-2a86-429e-8d5e-52dd3e0f167f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:49.313873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add6060-2a86-429e-8d5e-52dd3e0f167f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:49.327208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dafd4-1c57-4830-8019-60e4642e5b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:49.327801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dafd4-1c57-4830-8019-60e4642e5b4c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:49.328078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dafd4-1c57-4830-8019-60e4642e5b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:49.328349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dafd4-1c57-4830-8019-60e4642e5b4c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:49.328991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dafd4-1c57-4830-8019-60e4642e5b4c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:49.330404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dafd4-1c57-4830-8019-60e4642e5b4c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:49.347423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 379/763] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 26 07:14:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:49.348382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add6060-2a86-429e-8d5e-52dd3e0f167f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-798dafd4-1c57-4830-8019-60e4642e5b4c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:49.350166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:49.351082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:14:49.351943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:49.356055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 385/764] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jul 26 07:14:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:49.370287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dafd4-1c57-4830-8019-60e4642e5b4c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:49.459602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add6060-2a86-429e-8d5e-52dd3e0f167f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:49.497702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:49.502098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623d16-87ec-4d8f-bcae-eac787fdcd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:49.502795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623d16-87ec-4d8f-bcae-eac787fdcd5a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:49.503068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623d16-87ec-4d8f-bcae-eac787fdcd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:49.503357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623d16-87ec-4d8f-bcae-eac787fdcd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:49.516414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22623d16-87ec-4d8f-bcae-eac787fdcd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:49.518064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22623d16-87ec-4d8f-bcae-eac787fdcd5a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-22623d16-87ec-4d8f-bcae-eac787fdcd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:49.534147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:49.535139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:49.536058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:49.536058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:49.536058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:49.536058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:49.540973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 380/765] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:49.542845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623d16-87ec-4d8f-bcae-eac787fdcd5a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:49.651875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623d16-87ec-4d8f-bcae-eac787fdcd5a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:49.689968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2536e-b6e1-4340-a735-def690128a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:49.690680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2536e-b6e1-4340-a735-def690128a65 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:49.690957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2536e-b6e1-4340-a735-def690128a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:49.691229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2536e-b6e1-4340-a735-def690128a65 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:49.691935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2536e-b6e1-4340-a735-def690128a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:49.692241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2536e-b6e1-4340-a735-def690128a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:49.695398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2536e-b6e1-4340-a735-def690128a65 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:49.709363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 381/766] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:49.710722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78b99d-b631-438f-8ce9-c1199f264a8d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:49.711006 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78b99d-b631-438f-8ce9-c1199f264a8d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:49.711268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78b99d-b631-438f-8ce9-c1199f264a8d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:49.715828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 382/767] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:49.716886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78b99d-b631-438f-8ce9-c1199f264a8d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:49.734095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dafd4-1c57-4830-8019-60e4642e5b4c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:49.758059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:49.759450 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:49.780751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08898ab0-28d5-4e71-b535-39e75e97a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:49.781413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898ab0-28d5-4e71-b535-39e75e97a3ea None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:49.781702 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898ab0-28d5-4e71-b535-39e75e97a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:49.781970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898ab0-28d5-4e71-b535-39e75e97a3ea None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:49.782672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08898ab0-28d5-4e71-b535-39e75e97a3ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:49.782966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08898ab0-28d5-4e71-b535-39e75e97a3ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:49.784435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08898ab0-28d5-4e71-b535-39e75e97a3ea None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:49.789761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 386/768] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 26 07:14:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:49.790991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d3d70-6711-420c-993d-42d9b35f4f8a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:49.791271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d3d70-6711-420c-993d-42d9b35f4f8a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:49.791542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d3d70-6711-420c-993d-42d9b35f4f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:49.810121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0c4d3d70-6711-420c-993d-42d9b35f4f8a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:49.811394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0c4d3d70-6711-420c-993d-42d9b35f4f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:49.843235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78b99d-b631-438f-8ce9-c1199f264a8d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:49.883569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 387/769] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:49.884493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d3d70-6711-420c-993d-42d9b35f4f8a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:49.886087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7d7fa-d915-4fdd-810c-4ec37c745337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:49.886759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7d7fa-d915-4fdd-810c-4ec37c745337 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:49.887045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7d7fa-d915-4fdd-810c-4ec37c745337 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:49.887318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7d7fa-d915-4fdd-810c-4ec37c745337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:49.901724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7d7fa-d915-4fdd-810c-4ec37c745337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:49.905497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7d7fa-d915-4fdd-810c-4ec37c745337 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-73d7d7fa-d915-4fdd-810c-4ec37c745337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:49.926404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:49.927996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 383/770] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:49.929714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7d7fa-d915-4fdd-810c-4ec37c745337 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.019072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d3d70-6711-420c-993d-42d9b35f4f8a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.034407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:50.040651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:50.047407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7d7fa-d915-4fdd-810c-4ec37c745337 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.065520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fb544-f067-4634-b23a-6e72a47b341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.066296 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fb544-f067-4634-b23a-6e72a47b341c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.066574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fb544-f067-4634-b23a-6e72a47b341c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.066842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fb544-f067-4634-b23a-6e72a47b341c None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.067558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fb544-f067-4634-b23a-6e72a47b341c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:50.067859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fb544-f067-4634-b23a-6e72a47b341c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:50.069226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fb544-f067-4634-b23a-6e72a47b341c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:50.078892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 388/771] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 26 07:14:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:50.078892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fb544-f067-4634-b23a-6e72a47b341c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.090575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50adba-0763-44bb-937e-4907bd20e8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.091234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50adba-0763-44bb-937e-4907bd20e8ff None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.091520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50adba-0763-44bb-937e-4907bd20e8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.091794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50adba-0763-44bb-937e-4907bd20e8ff None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.092435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50adba-0763-44bb-937e-4907bd20e8ff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:50.094228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50adba-0763-44bb-937e-4907bd20e8ff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3d50adba-0763-44bb-937e-4907bd20e8ff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:50.103534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:50.104539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:50.110267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 384/772] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:49 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:50.111094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8fb6-e164-46c5-a74a-d86a53b8cae9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.111094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8fb6-e164-46c5-a74a-d86a53b8cae9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.111094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8fb6-e164-46c5-a74a-d86a53b8cae9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.112240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 385/773] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:50.113036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8fb6-e164-46c5-a74a-d86a53b8cae9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.185641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fb544-f067-4634-b23a-6e72a47b341c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.220502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9f2fe-1b12-45f8-b3ff-27eeafef3650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.221122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9f2fe-1b12-45f8-b3ff-27eeafef3650 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.221452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9f2fe-1b12-45f8-b3ff-27eeafef3650 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.221721 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9f2fe-1b12-45f8-b3ff-27eeafef3650 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.222465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8fb6-e164-46c5-a74a-d86a53b8cae9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.222569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9f2fe-1b12-45f8-b3ff-27eeafef3650 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:50.222764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9f2fe-1b12-45f8-b3ff-27eeafef3650 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:50.224188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9f2fe-1b12-45f8-b3ff-27eeafef3650 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:50.240843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 389/774] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:50.240843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9f2fe-1b12-45f8-b3ff-27eeafef3650 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.264512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7568f3-5edb-49b3-a827-d5c260a70e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.265498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7568f3-5edb-49b3-a827-d5c260a70e34 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.265783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7568f3-5edb-49b3-a827-d5c260a70e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.266244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7568f3-5edb-49b3-a827-d5c260a70e34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.267132 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7568f3-5edb-49b3-a827-d5c260a70e34 None admin] RBAC: Adding query filter params (interface=public, service_id=f54078506f804fdea1546409c16f734c, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:50.267434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7568f3-5edb-49b3-a827-d5c260a70e34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:50.269026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7568f3-5edb-49b3-a827-d5c260a70e34 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:50.272707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:50.284814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 386/775] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 26 07:14:50 2022] GET /identity/v3/endpoints?service_id=f54078506f804fdea1546409c16f734c&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:50.284814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cad86-7aa2-49f2-b613-b4d8f166cb52 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.284814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cad86-7aa2-49f2-b613-b4d8f166cb52 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.284814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cad86-7aa2-49f2-b613-b4d8f166cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.300393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fe2cad86-7aa2-49f2-b613-b4d8f166cb52 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:50.301651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe2cad86-7aa2-49f2-b613-b4d8f166cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:50.320657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:50.349946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9f2fe-1b12-45f8-b3ff-27eeafef3650 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.382840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 387/776] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:50.382840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cad86-7aa2-49f2-b613-b4d8f166cb52 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.386087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff1d09-4518-4cfd-84a7-7156b11dd7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.386842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff1d09-4518-4cfd-84a7-7156b11dd7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.387212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff1d09-4518-4cfd-84a7-7156b11dd7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.387570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff1d09-4518-4cfd-84a7-7156b11dd7d1 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.388370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff1d09-4518-4cfd-84a7-7156b11dd7d1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:50.388766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff1d09-4518-4cfd-84a7-7156b11dd7d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:50.390324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff1d09-4518-4cfd-84a7-7156b11dd7d1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:50.397999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 390/777] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:14:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:50.398762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff1d09-4518-4cfd-84a7-7156b11dd7d1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.496239 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cad86-7aa2-49f2-b613-b4d8f166cb52 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.512449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:50.516513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff1d09-4518-4cfd-84a7-7156b11dd7d1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.534350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706abcb-cb1b-4ad6-b3d6-792c0fd9fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.535049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706abcb-cb1b-4ad6-b3d6-792c0fd9fcf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.535326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706abcb-cb1b-4ad6-b3d6-792c0fd9fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.535605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706abcb-cb1b-4ad6-b3d6-792c0fd9fcf1 None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/c70a0ca34a3940d1b067430c9c2dc64e/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.537639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706abcb-cb1b-4ad6-b3d6-792c0fd9fcf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=c70a0ca34a3940d1b067430c9c2dc64e, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:50.539082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706abcb-cb1b-4ad6-b3d6-792c0fd9fcf1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:50.555121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffc5b-bdc0-4981-8692-a6adb5341ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.565302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 388/778] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:14:50 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/c70a0ca34a3940d1b067430c9c2dc64e/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:50.565572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffc5b-bdc0-4981-8692-a6adb5341ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.565572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffc5b-bdc0-4981-8692-a6adb5341ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.565572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffc5b-bdc0-4981-8692-a6adb5341ce3 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.565837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706abcb-cb1b-4ad6-b3d6-792c0fd9fcf1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.565933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ffc5b-bdc0-4981-8692-a6adb5341ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:50.565933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ffc5b-bdc0-4981-8692-a6adb5341ce3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:50.572675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 391/779] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 26 07:14:50 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:50.573797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffc5b-bdc0-4981-8692-a6adb5341ce3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.585022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:50.706461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffc5b-bdc0-4981-8692-a6adb5341ce3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.721887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706abcb-cb1b-4ad6-b3d6-792c0fd9fcf1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.756326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ce50-444b-48fc-86d4-b89aaa83258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.756903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ce50-444b-48fc-86d4-b89aaa83258f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.757491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ce50-444b-48fc-86d4-b89aaa83258f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.757771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ce50-444b-48fc-86d4-b89aaa83258f None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.758500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58ce50-444b-48fc-86d4-b89aaa83258f None admin] RBAC: Adding query filter params (type=network) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:50.759088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58ce50-444b-48fc-86d4-b89aaa83258f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:50.761455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58ce50-444b-48fc-86d4-b89aaa83258f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:50.769111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 392/780] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:14:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:50.770010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408de4d-8814-4ffd-a9b9-1d39fbd8018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.770611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0930eb-0cb0-4086-ac6b-f6fbebd95faa None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.770900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0930eb-0cb0-4086-ac6b-f6fbebd95faa None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.771061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408de4d-8814-4ffd-a9b9-1d39fbd8018b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.771163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0930eb-0cb0-4086-ac6b-f6fbebd95faa None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.771536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408de4d-8814-4ffd-a9b9-1d39fbd8018b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.771904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408de4d-8814-4ffd-a9b9-1d39fbd8018b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.772885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 393/781] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:50.776674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0930eb-0cb0-4086-ac6b-f6fbebd95faa None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.792385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408de4d-8814-4ffd-a9b9-1d39fbd8018b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0408de4d-8814-4ffd-a9b9-1d39fbd8018b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:50.799455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:50.801500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 389/782] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:50.803187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8ee4e-be19-469e-bec5-469e0cc19808 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.804701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8ee4e-be19-469e-bec5-469e0cc19808 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.804701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8ee4e-be19-469e-bec5-469e0cc19808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.819145 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:50.827070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fdc8ee4e-be19-469e-bec5-469e0cc19808 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:50.828291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fdc8ee4e-be19-469e-bec5-469e0cc19808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:50.912550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0930eb-0cb0-4086-ac6b-f6fbebd95faa None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:50.920012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 390/783] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:50.921642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8ee4e-be19-469e-bec5-469e0cc19808 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:50.925226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:50.975556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1bdb3-9f42-4581-83cd-f2a07b147b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:50.976939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1bdb3-9f42-4581-83cd-f2a07b147b66 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:50.977467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1bdb3-9f42-4581-83cd-f2a07b147b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:50.978287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1bdb3-9f42-4581-83cd-f2a07b147b66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:50.979569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1bdb3-9f42-4581-83cd-f2a07b147b66 None admin] RBAC: Adding query filter params (interface=public, service_id=999f2e8d21b946be9a37bbebdbbc14e5, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:50.980061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1bdb3-9f42-4581-83cd-f2a07b147b66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:50.982440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1bdb3-9f42-4581-83cd-f2a07b147b66 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:50.993801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 394/784] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 26 07:14:50 2022] GET /identity/v3/endpoints?service_id=999f2e8d21b946be9a37bbebdbbc14e5&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:50.999533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1bdb3-9f42-4581-83cd-f2a07b147b66 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:51.043870 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8ee4e-be19-469e-bec5-469e0cc19808 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:51.082688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb9011-b2d0-4621-911d-33a70c320362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:51.083359 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb9011-b2d0-4621-911d-33a70c320362 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:51.083647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb9011-b2d0-4621-911d-33a70c320362 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:51.083923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb9011-b2d0-4621-911d-33a70c320362 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:51.084687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb9011-b2d0-4621-911d-33a70c320362 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:51.084993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb9011-b2d0-4621-911d-33a70c320362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:51.086595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb9011-b2d0-4621-911d-33a70c320362 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:51.103076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 391/785] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:51.104387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb9011-b2d0-4621-911d-33a70c320362 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:51.131403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:51.144030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1bdb3-9f42-4581-83cd-f2a07b147b66 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:51.190425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17feb73-1fea-4e6d-bc81-4e472860af6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:51.191777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17feb73-1fea-4e6d-bc81-4e472860af6f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:51.192792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17feb73-1fea-4e6d-bc81-4e472860af6f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:51.193618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17feb73-1fea-4e6d-bc81-4e472860af6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:51.204354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:51.213640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17feb73-1fea-4e6d-bc81-4e472860af6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a17feb73-1fea-4e6d-bc81-4e472860af6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:51.221433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:51.222531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:51.223394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:51.226396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 395/786] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:51.227485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17feb73-1fea-4e6d-bc81-4e472860af6f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:51.255055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb9011-b2d0-4621-911d-33a70c320362 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:51.292764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e7cc2-6605-4a20-9013-5c6ad445fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:51.293784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e7cc2-6605-4a20-9013-5c6ad445fbae None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:51.294329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e7cc2-6605-4a20-9013-5c6ad445fbae None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:51.294794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e7cc2-6605-4a20-9013-5c6ad445fbae None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:51.295652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e7cc2-6605-4a20-9013-5c6ad445fbae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:51.297293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e7cc2-6605-4a20-9013-5c6ad445fbae None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:51.309609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 392/787] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 26 07:14:51 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:51.310973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e7cc2-6605-4a20-9013-5c6ad445fbae None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:51.341018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17feb73-1fea-4e6d-bc81-4e472860af6f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:51.388250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44004-b653-4eaa-9487-79578f4ca926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:51.389102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44004-b653-4eaa-9487-79578f4ca926 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:51.389423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44004-b653-4eaa-9487-79578f4ca926 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:51.389699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44004-b653-4eaa-9487-79578f4ca926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:51.415844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb44004-b653-4eaa-9487-79578f4ca926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:51.418467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb44004-b653-4eaa-9487-79578f4ca926 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-deb44004-b653-4eaa-9487-79578f4ca926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:51.451835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:51.452939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:51.453883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:51.453883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:51.453883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:51.453883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:51.458845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 396/788] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:51.465007 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44004-b653-4eaa-9487-79578f4ca926 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:51.473646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:51.539311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e7cc2-6605-4a20-9013-5c6ad445fbae None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:51.580006 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:51.588996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25900c-af8f-40b7-bfdb-897175d4813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:51.589714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25900c-af8f-40b7-bfdb-897175d4813a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:51.589999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25900c-af8f-40b7-bfdb-897175d4813a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:51.590277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25900c-af8f-40b7-bfdb-897175d4813a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:51.591148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25900c-af8f-40b7-bfdb-897175d4813a None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:51.591421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25900c-af8f-40b7-bfdb-897175d4813a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:51.593224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25900c-af8f-40b7-bfdb-897175d4813a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:51.603310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 393/789] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:51.609199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25900c-af8f-40b7-bfdb-897175d4813a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:51.640458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44004-b653-4eaa-9487-79578f4ca926 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:51.689391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edca7e8-2b7f-4ff0-89ae-37fdb8e7ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:51.690454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edca7e8-2b7f-4ff0-89ae-37fdb8e7ee89 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:51.690937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edca7e8-2b7f-4ff0-89ae-37fdb8e7ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:51.691470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edca7e8-2b7f-4ff0-89ae-37fdb8e7ee89 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:51.692428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edca7e8-2b7f-4ff0-89ae-37fdb8e7ee89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:51.699647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edca7e8-2b7f-4ff0-89ae-37fdb8e7ee89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:51.702112 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edca7e8-2b7f-4ff0-89ae-37fdb8e7ee89 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:51.725342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 397/790] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:51.738419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edca7e8-2b7f-4ff0-89ae-37fdb8e7ee89 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:51.801492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25900c-af8f-40b7-bfdb-897175d4813a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:51.812163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:51.879668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499f2e5-0300-4d65-a7a5-979624eece0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:51.880278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499f2e5-0300-4d65-a7a5-979624eece0b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:51.880558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499f2e5-0300-4d65-a7a5-979624eece0b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:51.880871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499f2e5-0300-4d65-a7a5-979624eece0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:51.890775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edca7e8-2b7f-4ff0-89ae-37fdb8e7ee89 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:51.909754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499f2e5-0300-4d65-a7a5-979624eece0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:51.913877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499f2e5-0300-4d65-a7a5-979624eece0b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9499f2e5-0300-4d65-a7a5-979624eece0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:51.948266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:51.950097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:51.951302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:51.951302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:51.951302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:51.951302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:51.954556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 394/791] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:51.955661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499f2e5-0300-4d65-a7a5-979624eece0b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:51.970901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb7415-6ca5-4799-aa6d-ffa7ef53e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:51.971633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb7415-6ca5-4799-aa6d-ffa7ef53e444 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:51.971917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb7415-6ca5-4799-aa6d-ffa7ef53e444 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:51.972191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb7415-6ca5-4799-aa6d-ffa7ef53e444 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:51.990457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb7415-6ca5-4799-aa6d-ffa7ef53e444 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:51.992292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb7415-6ca5-4799-aa6d-ffa7ef53e444 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3afb7415-6ca5-4799-aa6d-ffa7ef53e444 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:52.011006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:52.012036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:52.012989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 398/792] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:52.022360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb7415-6ca5-4799-aa6d-ffa7ef53e444 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:52.027611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:52.129232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499f2e5-0300-4d65-a7a5-979624eece0b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:52.198877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16bd5d-bef1-49c1-ac82-5d7f068d2c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:52.199519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16bd5d-bef1-49c1-ac82-5d7f068d2c95 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:52.199857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16bd5d-bef1-49c1-ac82-5d7f068d2c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:52.200061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16bd5d-bef1-49c1-ac82-5d7f068d2c95 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:52.200772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16bd5d-bef1-49c1-ac82-5d7f068d2c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:52.201074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16bd5d-bef1-49c1-ac82-5d7f068d2c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:52.202483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16bd5d-bef1-49c1-ac82-5d7f068d2c95 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:52.220142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb7415-6ca5-4799-aa6d-ffa7ef53e444 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:52.235901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 395/793] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:52.241527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16bd5d-bef1-49c1-ac82-5d7f068d2c95 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:52.252111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:52.273191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8b36-005c-4564-982e-c68f4934d8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:52.274222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8b36-005c-4564-982e-c68f4934d8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:52.274716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8b36-005c-4564-982e-c68f4934d8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:52.275178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8b36-005c-4564-982e-c68f4934d8b8 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:52.276204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b8b36-005c-4564-982e-c68f4934d8b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:52.276703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b8b36-005c-4564-982e-c68f4934d8b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:52.278396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b8b36-005c-4564-982e-c68f4934d8b8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:52.313588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 399/794] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 26 07:14:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:52.323127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8b36-005c-4564-982e-c68f4934d8b8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:52.407770 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16bd5d-bef1-49c1-ac82-5d7f068d2c95 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:52.407770 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:52.449860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caef5e-7b3a-4a7a-b076-5d1378bfcd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:52.450548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caef5e-7b3a-4a7a-b076-5d1378bfcd32 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:52.451487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caef5e-7b3a-4a7a-b076-5d1378bfcd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:52.451986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caef5e-7b3a-4a7a-b076-5d1378bfcd32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:52.461147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32caef5e-7b3a-4a7a-b076-5d1378bfcd32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:52.463308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32caef5e-7b3a-4a7a-b076-5d1378bfcd32 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-32caef5e-7b3a-4a7a-b076-5d1378bfcd32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:52.479922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:52.480942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:52.481941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 396/795] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:14:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:52.487964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caef5e-7b3a-4a7a-b076-5d1378bfcd32 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:52.561721 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8b36-005c-4564-982e-c68f4934d8b8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:52.641868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caef5e-7b3a-4a7a-b076-5d1378bfcd32 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:52.681693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18eac8-2b18-4293-aa54-c107dbe074e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:52.682367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18eac8-2b18-4293-aa54-c107dbe074e8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:52.682643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18eac8-2b18-4293-aa54-c107dbe074e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:52.682985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18eac8-2b18-4293-aa54-c107dbe074e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:52.701757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31becaa6-9d30-466f-abc4-a9d67943a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:52.702348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31becaa6-9d30-466f-abc4-a9d67943a808 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:52.702628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31becaa6-9d30-466f-abc4-a9d67943a808 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:52.702904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31becaa6-9d30-466f-abc4-a9d67943a808 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:52.703729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31becaa6-9d30-466f-abc4-a9d67943a808 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:52.704036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31becaa6-9d30-466f-abc4-a9d67943a808 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:52.705550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31becaa6-9d30-466f-abc4-a9d67943a808 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:52.710092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18eac8-2b18-4293-aa54-c107dbe074e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:52.711572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18eac8-2b18-4293-aa54-c107dbe074e8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6d18eac8-2b18-4293-aa54-c107dbe074e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:52.740385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:52.741402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:52.742305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:52.742305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:52.742305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:52.742305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:52.743449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 400/796] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:52.745656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 397/797] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 26 07:14:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:52.750394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18eac8-2b18-4293-aa54-c107dbe074e8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:52.752816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31becaa6-9d30-466f-abc4-a9d67943a808 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:52.801293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:52.818389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:52.912585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31becaa6-9d30-466f-abc4-a9d67943a808 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:52.935677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18eac8-2b18-4293-aa54-c107dbe074e8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:52.952522 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757caf9f-83f9-4b66-8361-0d1483cf30ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:52.953111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757caf9f-83f9-4b66-8361-0d1483cf30ac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:52.953571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757caf9f-83f9-4b66-8361-0d1483cf30ac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:52.953902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757caf9f-83f9-4b66-8361-0d1483cf30ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:52.966389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757caf9f-83f9-4b66-8361-0d1483cf30ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:52.968252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757caf9f-83f9-4b66-8361-0d1483cf30ac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:52.980705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c32f80-bda6-409c-8048-dae1f61fae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:52.981710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c32f80-bda6-409c-8048-dae1f61fae4f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:52.982185 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c32f80-bda6-409c-8048-dae1f61fae4f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:52.982661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c32f80-bda6-409c-8048-dae1f61fae4f None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:52.983721 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c32f80-bda6-409c-8048-dae1f61fae4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:52.984240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c32f80-bda6-409c-8048-dae1f61fae4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-757caf9f-83f9-4b66-8361-0d1483cf30ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:52.985426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:52.986316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:52.987431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:52.987431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:52.987431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:52.987431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:52.987431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 398/798] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:52.988104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976da17-f7da-4dfa-8054-517171e75a98 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:52.988206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976da17-f7da-4dfa-8054-517171e75a98 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:52.988472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976da17-f7da-4dfa-8054-517171e75a98 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:52.989168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c32f80-bda6-409c-8048-dae1f61fae4f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:52.990021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 399/799] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:52.991059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e584c-f8d3-429f-8044-1e76791d447a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:52.991375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e584c-f8d3-429f-8044-1e76791d447a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:52.991646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e584c-f8d3-429f-8044-1e76791d447a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:52.992974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 400/800] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:52.996581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e584c-f8d3-429f-8044-1e76791d447a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.007928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 401/801] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:53.009602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e25bb4-4988-41d7-b284-76e4d21f20e4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.010124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e25bb4-4988-41d7-b284-76e4d21f20e4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.010616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e25bb4-4988-41d7-b284-76e4d21f20e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.030768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-74e25bb4-4988-41d7-b284-76e4d21f20e4 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:53.032248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-74e25bb4-4988-41d7-b284-76e4d21f20e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:53.087905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:53.118281 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 402/802] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:53.119023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e584c-f8d3-429f-8044-1e76791d447a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:53.119566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1740238-0e61-4269-9b13-e5225efae263 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.119847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1740238-0e61-4269-9b13-e5225efae263 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.120119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1740238-0e61-4269-9b13-e5225efae263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.140782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a1740238-0e61-4269-9b13-e5225efae263 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:53.142769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a1740238-0e61-4269-9b13-e5225efae263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:53.164814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2a28b-9f03-48ce-b964-bcce36f680b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:53.165041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:53.165836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2a28b-9f03-48ce-b964-bcce36f680b2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.166255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2a28b-9f03-48ce-b964-bcce36f680b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.166701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2a28b-9f03-48ce-b964-bcce36f680b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.167542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2a28b-9f03-48ce-b964-bcce36f680b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:53.167857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2a28b-9f03-48ce-b964-bcce36f680b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:53.169283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2a28b-9f03-48ce-b964-bcce36f680b2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:53.182929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 401/803] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:53.183621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2a28b-9f03-48ce-b964-bcce36f680b2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.224881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 403/804] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:53.227855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1740238-0e61-4269-9b13-e5225efae263 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.317576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2a28b-9f03-48ce-b964-bcce36f680b2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:53.356135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca59fda-3323-4e82-9261-61d4ec14a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:53.357179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca59fda-3323-4e82-9261-61d4ec14a320 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.357544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca59fda-3323-4e82-9261-61d4ec14a320 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.357807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca59fda-3323-4e82-9261-61d4ec14a320 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.359977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1740238-0e61-4269-9b13-e5225efae263 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:53.360130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:53.368972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca59fda-3323-4e82-9261-61d4ec14a320 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:53.370502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca59fda-3323-4e82-9261-61d4ec14a320 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8ca59fda-3323-4e82-9261-61d4ec14a320 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:53.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:53.386461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 402/805] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:53.387374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca59fda-3323-4e82-9261-61d4ec14a320 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.406302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3897-3585-400c-a94d-70cc4776746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:53.407244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3897-3585-400c-a94d-70cc4776746e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.407528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3897-3585-400c-a94d-70cc4776746e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.407967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3897-3585-400c-a94d-70cc4776746e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.420007 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd3897-3585-400c-a94d-70cc4776746e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b8cd3897-3585-400c-a94d-70cc4776746e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:53.425165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:53.426668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 404/806] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:53.427542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3897-3585-400c-a94d-70cc4776746e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.447085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:53.511741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca59fda-3323-4e82-9261-61d4ec14a320 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:53.547900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3897-3585-400c-a94d-70cc4776746e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:53.556188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c788-fd3e-43b6-83b2-4158169eb169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:53.556846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c788-fd3e-43b6-83b2-4158169eb169 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.557131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c788-fd3e-43b6-83b2-4158169eb169 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.557433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c788-fd3e-43b6-83b2-4158169eb169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.568358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c788-fd3e-43b6-83b2-4158169eb169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:53.570439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c788-fd3e-43b6-83b2-4158169eb169 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e177c788-fd3e-43b6-83b2-4158169eb169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:53.584608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:53.585643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:53.586563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:53.586563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:53.586563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:53.586563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:53.586563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:53.586563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:53.586563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:53.586563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:53.586563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 403/807] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:53.587062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c788-fd3e-43b6-83b2-4158169eb169 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.590550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514de7e-423b-446b-b9bd-a5cf0de0888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:53.591565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514de7e-423b-446b-b9bd-a5cf0de0888a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.591851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514de7e-423b-446b-b9bd-a5cf0de0888a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.592132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514de7e-423b-446b-b9bd-a5cf0de0888a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.593170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514de7e-423b-446b-b9bd-a5cf0de0888a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:53.594635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514de7e-423b-446b-b9bd-a5cf0de0888a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7514de7e-423b-446b-b9bd-a5cf0de0888a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:53.604595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:53.605866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:53.606872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 405/808] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jul 26 07:14:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:53.607716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514de7e-423b-446b-b9bd-a5cf0de0888a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.662911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:53.702551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:53.729291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c788-fd3e-43b6-83b2-4158169eb169 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:53.729544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514de7e-423b-446b-b9bd-a5cf0de0888a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:53.765122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60d44e-6412-424b-8425-6d3c47e589da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:53.765697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d44e-6412-424b-8425-6d3c47e589da None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.765983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d44e-6412-424b-8425-6d3c47e589da None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.766264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d44e-6412-424b-8425-6d3c47e589da None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.767026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60d44e-6412-424b-8425-6d3c47e589da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:53.767338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60d44e-6412-424b-8425-6d3c47e589da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:53.768898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60d44e-6412-424b-8425-6d3c47e589da None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:53.769336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed23f7-3057-47d6-8f73-56114fcc3a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:53.769967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed23f7-3057-47d6-8f73-56114fcc3a8d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.770245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed23f7-3057-47d6-8f73-56114fcc3a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.770576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed23f7-3057-47d6-8f73-56114fcc3a8d None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.771237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed23f7-3057-47d6-8f73-56114fcc3a8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:53.772263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed23f7-3057-47d6-8f73-56114fcc3a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:53.772901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed23f7-3057-47d6-8f73-56114fcc3a8d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:53.781512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 404/809] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:53.782363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60d44e-6412-424b-8425-6d3c47e589da None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.788329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 406/810] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:53.788329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed23f7-3057-47d6-8f73-56114fcc3a8d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.890949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60d44e-6412-424b-8425-6d3c47e589da None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:53.898161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed23f7-3057-47d6-8f73-56114fcc3a8d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:53.906621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:53.929651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d327794-83dc-44cc-861d-de4acaf9a49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:53.930291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327794-83dc-44cc-861d-de4acaf9a49e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.930559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327794-83dc-44cc-861d-de4acaf9a49e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.930822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327794-83dc-44cc-861d-de4acaf9a49e None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.931578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d327794-83dc-44cc-861d-de4acaf9a49e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:53.931873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d327794-83dc-44cc-861d-de4acaf9a49e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:53.933324 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d327794-83dc-44cc-861d-de4acaf9a49e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:53.936218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59a399-cfbb-4a8d-b5b0-695b292d8fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:53.936850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59a399-cfbb-4a8d-b5b0-695b292d8fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.937128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59a399-cfbb-4a8d-b5b0-695b292d8fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.937431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59a399-cfbb-4a8d-b5b0-695b292d8fa1 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.938101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59a399-cfbb-4a8d-b5b0-695b292d8fa1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:53.938400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59a399-cfbb-4a8d-b5b0-695b292d8fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:53.939785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59a399-cfbb-4a8d-b5b0-695b292d8fa1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:53.944584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 407/811] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 26 07:14:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:53.945834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b47aa-4e56-437f-98c8-e7decb62aa88 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:53.946114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b47aa-4e56-437f-98c8-e7decb62aa88 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:53.953506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b47aa-4e56-437f-98c8-e7decb62aa88 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:53.953708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 405/812] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:53.953708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d327794-83dc-44cc-861d-de4acaf9a49e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.953877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 408/813] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:53.953877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b47aa-4e56-437f-98c8-e7decb62aa88 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:53.954824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:54.072813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b47aa-4e56-437f-98c8-e7decb62aa88 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:54.074790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d327794-83dc-44cc-861d-de4acaf9a49e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:54.108465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f6e1-dc80-4a6b-b79c-af726203ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:54.109125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f6e1-dc80-4a6b-b79c-af726203ad22 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.109434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f6e1-dc80-4a6b-b79c-af726203ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.109713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f6e1-dc80-4a6b-b79c-af726203ad22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.110767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3dbb-7d2d-4fcc-b07e-72d8159e63cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:54.111463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3dbb-7d2d-4fcc-b07e-72d8159e63cc None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.111930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3dbb-7d2d-4fcc-b07e-72d8159e63cc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.112922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3dbb-7d2d-4fcc-b07e-72d8159e63cc None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/b5a03e5f2dee4bdeac26236d8127588c/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.114533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b3dbb-7d2d-4fcc-b07e-72d8159e63cc None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=b5a03e5f2dee4bdeac26236d8127588c, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:54.115979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b3dbb-7d2d-4fcc-b07e-72d8159e63cc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:54.122859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127f6e1-dc80-4a6b-b79c-af726203ad22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:54.124415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127f6e1-dc80-4a6b-b79c-af726203ad22 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:54.131274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 406/814] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:14:53 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/b5a03e5f2dee4bdeac26236d8127588c/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:54.132534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0321-c561-4ffd-bc93-60a23678efa6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.132817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0321-c561-4ffd-bc93-60a23678efa6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.133089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0321-c561-4ffd-bc93-60a23678efa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3127f6e1-dc80-4a6b-b79c-af726203ad22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:54.142421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:54.143415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:54.144321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:54.144321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:54.144321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:54.144321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:54.151279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 409/815] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:54.151279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f6e1-dc80-4a6b-b79c-af726203ad22 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:54.158175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9cbf0321-c561-4ffd-bc93-60a23678efa6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:54.159752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9cbf0321-c561-4ffd-bc93-60a23678efa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:54.195387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:54.221909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:54.261295 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 407/816] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:54.261295 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0321-c561-4ffd-bc93-60a23678efa6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:54.275987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f6e1-dc80-4a6b-b79c-af726203ad22 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:54.321311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447889a-bf5e-4e38-a8d8-0ed2418c946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:54.322036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447889a-bf5e-4e38-a8d8-0ed2418c946c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.322380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447889a-bf5e-4e38-a8d8-0ed2418c946c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.322724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447889a-bf5e-4e38-a8d8-0ed2418c946c None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.323560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447889a-bf5e-4e38-a8d8-0ed2418c946c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:54.323879 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447889a-bf5e-4e38-a8d8-0ed2418c946c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:54.325368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447889a-bf5e-4e38-a8d8-0ed2418c946c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:54.331744 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 410/817] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 26 07:14:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:54.332437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447889a-bf5e-4e38-a8d8-0ed2418c946c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:54.391937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0321-c561-4ffd-bc93-60a23678efa6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:54.431109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663681-d7d6-412c-851a-60cb87684516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:54.431897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663681-d7d6-412c-851a-60cb87684516 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.432246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663681-d7d6-412c-851a-60cb87684516 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.432616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663681-d7d6-412c-851a-60cb87684516 None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/53d237d0049541999d292b88d851e95a/roles/726231471ff241e9af5bcf89430bd2c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.448861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2663681-d7d6-412c-851a-60cb87684516 None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=53d237d0049541999d292b88d851e95a, role_id=726231471ff241e9af5bcf89430bd2c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:54.450381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2663681-d7d6-412c-851a-60cb87684516 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:54.451872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447889a-bf5e-4e38-a8d8-0ed2418c946c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:54.465985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 408/818] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:14:54 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/53d237d0049541999d292b88d851e95a/roles/726231471ff241e9af5bcf89430bd2c0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:14:54.473645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663681-d7d6-412c-851a-60cb87684516 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:54.478953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:54.494017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:54.505225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ab8a7-5fcf-4293-83e1-73f3d832eee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:54.506127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ab8a7-5fcf-4293-83e1-73f3d832eee1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.506692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ab8a7-5fcf-4293-83e1-73f3d832eee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.507065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ab8a7-5fcf-4293-83e1-73f3d832eee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.509003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ab8a7-5fcf-4293-83e1-73f3d832eee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:54.509709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ab8a7-5fcf-4293-83e1-73f3d832eee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:54.511517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ab8a7-5fcf-4293-83e1-73f3d832eee1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:54.532011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 411/819] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:54.533122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ab8a7-5fcf-4293-83e1-73f3d832eee1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:54.602690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663681-d7d6-412c-851a-60cb87684516 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:54.644389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921e07-bd0b-447d-be98-3f8d603d2b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:54.644960 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ab8a7-5fcf-4293-83e1-73f3d832eee1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:54.645235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921e07-bd0b-447d-be98-3f8d603d2b34 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.645624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921e07-bd0b-447d-be98-3f8d603d2b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.646024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921e07-bd0b-447d-be98-3f8d603d2b34 None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.646766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99921e07-bd0b-447d-be98-3f8d603d2b34 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:54.649199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99921e07-bd0b-447d-be98-3f8d603d2b34 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-99921e07-bd0b-447d-be98-3f8d603d2b34 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:54.659606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:54.660895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:14:54.662216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:54.662979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 409/820] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:54 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:54.663486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921e07-bd0b-447d-be98-3f8d603d2b34 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:54.710313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48878c-2478-4502-a396-d84920698b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:54.712173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48878c-2478-4502-a396-d84920698b12 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.712649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48878c-2478-4502-a396-d84920698b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.713128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48878c-2478-4502-a396-d84920698b12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.714062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48878c-2478-4502-a396-d84920698b12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:54.715638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48878c-2478-4502-a396-d84920698b12 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:54.746945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 412/821] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:14:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:14:54.748337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48878c-2478-4502-a396-d84920698b12 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:54.761706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:54.794518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921e07-bd0b-447d-be98-3f8d603d2b34 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:54.802036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:54.860916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c07825-f384-47a5-9048-356a19b4cb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:54.862015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07825-f384-47a5-9048-356a19b4cb58 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.862671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07825-f384-47a5-9048-356a19b4cb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.863149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07825-f384-47a5-9048-356a19b4cb58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.873181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c07825-f384-47a5-9048-356a19b4cb58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:54.874900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c07825-f384-47a5-9048-356a19b4cb58 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-19c07825-f384-47a5-9048-356a19b4cb58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:54.903309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:54.904400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:14:54.905500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:54.913478 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 410/822] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 26 07:14:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:54.919409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c07825-f384-47a5-9048-356a19b4cb58 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:54.937212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48878c-2478-4502-a396-d84920698b12 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:54.982886 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b8927-054c-45a2-b7eb-42f6c5c96e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:54.983909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b8927-054c-45a2-b7eb-42f6c5c96e67 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:54.984421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b8927-054c-45a2-b7eb-42f6c5c96e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:54.984894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b8927-054c-45a2-b7eb-42f6c5c96e67 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:54.985820 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b8927-054c-45a2-b7eb-42f6c5c96e67 None admin] RBAC: Adding query filter params (name=network) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:54.986344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b8927-054c-45a2-b7eb-42f6c5c96e67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:54.988611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b8927-054c-45a2-b7eb-42f6c5c96e67 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:54.995378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 413/823] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:14:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:55.001805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b8927-054c-45a2-b7eb-42f6c5c96e67 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:55.065067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c07825-f384-47a5-9048-356a19b4cb58 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:55.102393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aab95-ec0b-4744-bf02-be4d6ba73dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:55.103115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aab95-ec0b-4744-bf02-be4d6ba73dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:55.103457 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aab95-ec0b-4744-bf02-be4d6ba73dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:55.103814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aab95-ec0b-4744-bf02-be4d6ba73dd0 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:55.104680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aab95-ec0b-4744-bf02-be4d6ba73dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:55.106537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aab95-ec0b-4744-bf02-be4d6ba73dd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:55.107345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aab95-ec0b-4744-bf02-be4d6ba73dd0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:55.110715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:55.128128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 411/824] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 26 07:14:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:14:55.130847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:55.133252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aab95-ec0b-4744-bf02-be4d6ba73dd0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:55.136372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b8927-054c-45a2-b7eb-42f6c5c96e67 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:55.179617 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56dd78-5744-4755-ae41-018ff6a1ea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:55.181319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56dd78-5744-4755-ae41-018ff6a1ea5f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:55.181838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56dd78-5744-4755-ae41-018ff6a1ea5f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:55.182316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56dd78-5744-4755-ae41-018ff6a1ea5f None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:55.183673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56dd78-5744-4755-ae41-018ff6a1ea5f None admin] RBAC: Adding query filter params (type=network) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:55.184189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56dd78-5744-4755-ae41-018ff6a1ea5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:55.186506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56dd78-5744-4755-ae41-018ff6a1ea5f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:55.194355 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 414/825] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:14:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:55.202258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56dd78-5744-4755-ae41-018ff6a1ea5f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:55.249512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aab95-ec0b-4744-bf02-be4d6ba73dd0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:55.288175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a7162-9557-46c9-a0ae-813b83801460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:55.288821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a7162-9557-46c9-a0ae-813b83801460 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:55.289100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a7162-9557-46c9-a0ae-813b83801460 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:55.289404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a7162-9557-46c9-a0ae-813b83801460 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:55.355996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:55.368032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a7162-9557-46c9-a0ae-813b83801460 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:55.369966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a7162-9557-46c9-a0ae-813b83801460 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:55.478686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 412/826] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:14:55.484445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a7162-9557-46c9-a0ae-813b83801460 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:55.490180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56dd78-5744-4755-ae41-018ff6a1ea5f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:55.542368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4feb1a-bc07-4b7f-91d3-87f2e1b89363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:55.543693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4feb1a-bc07-4b7f-91d3-87f2e1b89363 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:55.544177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4feb1a-bc07-4b7f-91d3-87f2e1b89363 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:55.544674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4feb1a-bc07-4b7f-91d3-87f2e1b89363 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:55.545706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4feb1a-bc07-4b7f-91d3-87f2e1b89363 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:55.547423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4feb1a-bc07-4b7f-91d3-87f2e1b89363 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:55.589931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 415/827] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:14:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:14:55.681682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:55.688552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a7162-9557-46c9-a0ae-813b83801460 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:55.758224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea2f07-7c30-4e45-a00c-c46dd5d0f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:55.758844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea2f07-7c30-4e45-a00c-c46dd5d0f08d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:55.759129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea2f07-7c30-4e45-a00c-c46dd5d0f08d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:55.759410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea2f07-7c30-4e45-a00c-c46dd5d0f08d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:55.771873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea2f07-7c30-4e45-a00c-c46dd5d0f08d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:55.773490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea2f07-7c30-4e45-a00c-c46dd5d0f08d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-40ea2f07-7c30-4e45-a00c-c46dd5d0f08d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:55.792344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:55.793380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:55.794304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:55.794304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:55.794304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:55.794304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:55.794304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 413/828] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:55.799689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4feb1a-bc07-4b7f-91d3-87f2e1b89363 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:55.822125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:55.920489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4feb1a-bc07-4b7f-91d3-87f2e1b89363 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:55.959854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a36de-ed84-4771-a6f5-ca7f2388feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:55.960502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a36de-ed84-4771-a6f5-ca7f2388feb5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:55.960783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a36de-ed84-4771-a6f5-ca7f2388feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:55.961113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a36de-ed84-4771-a6f5-ca7f2388feb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:55.961863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a36de-ed84-4771-a6f5-ca7f2388feb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:55.962217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a36de-ed84-4771-a6f5-ca7f2388feb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:55.963612 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a36de-ed84-4771-a6f5-ca7f2388feb5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:55.978179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 416/829] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:55.983794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea2f07-7c30-4e45-a00c-c46dd5d0f08d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:56.103276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea2f07-7c30-4e45-a00c-c46dd5d0f08d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:56.139102 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f9160-6fa2-4fdb-9884-50e1dc8979cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:56.139757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f9160-6fa2-4fdb-9884-50e1dc8979cb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:56.140036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f9160-6fa2-4fdb-9884-50e1dc8979cb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:56.140308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f9160-6fa2-4fdb-9884-50e1dc8979cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:56.148294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f9160-6fa2-4fdb-9884-50e1dc8979cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:56.149848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f9160-6fa2-4fdb-9884-50e1dc8979cb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:56.153214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4f4f9160-6fa2-4fdb-9884-50e1dc8979cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:56.164624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:56.165686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:56.166746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:56.166746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:56.166746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:56.166746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:56.166746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:56.166746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:56.166746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:56.166746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:56.172189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a36de-ed84-4771-a6f5-ca7f2388feb5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:56.172668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 414/830] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:56.261703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:56.285090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a36de-ed84-4771-a6f5-ca7f2388feb5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:56.321509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6c685-b3e9-4421-be23-da3fcf52aa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:56.322166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c685-b3e9-4421-be23-da3fcf52aa07 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:56.322448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c685-b3e9-4421-be23-da3fcf52aa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:56.322723 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c685-b3e9-4421-be23-da3fcf52aa07 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:56.323502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6c685-b3e9-4421-be23-da3fcf52aa07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:56.323813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6c685-b3e9-4421-be23-da3fcf52aa07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:56.325320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6c685-b3e9-4421-be23-da3fcf52aa07 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:56.343274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 417/831] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:56.349279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f9160-6fa2-4fdb-9884-50e1dc8979cb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:56.454072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f9160-6fa2-4fdb-9884-50e1dc8979cb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:56.485763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6e997-bfbe-4a8b-b141-75c5ec96782b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:56.486095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6e997-bfbe-4a8b-b141-75c5ec96782b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:56.486305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6e997-bfbe-4a8b-b141-75c5ec96782b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:56.488078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 418/832] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:14:56.492867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c46b-2fa1-4f77-bc54-8fe2362dcd44 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:56.493459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c46b-2fa1-4f77-bc54-8fe2362dcd44 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:56.493545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc8601-f978-44d5-8ec2-aacfa505f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:56.493645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c46b-2fa1-4f77-bc54-8fe2362dcd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:56.494090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc8601-f978-44d5-8ec2-aacfa505f4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:56.494376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc8601-f978-44d5-8ec2-aacfa505f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:56.494653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc8601-f978-44d5-8ec2-aacfa505f4d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:56.495451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc8601-f978-44d5-8ec2-aacfa505f4d4 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=c70a0ca34a3940d1b067430c9c2dc64e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:56.495761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc8601-f978-44d5-8ec2-aacfa505f4d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:56.497205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc8601-f978-44d5-8ec2-aacfa505f4d4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:56.503776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 415/833] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:56 2022] GET /identity/v3/role_assignments?user.id=c70a0ca34a3940d1b067430c9c2dc64e&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:56.513402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a827c46b-2fa1-4f77-bc54-8fe2362dcd44 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:56.515070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a827c46b-2fa1-4f77-bc54-8fe2362dcd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:56.589194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 419/834] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:14:56.612938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc8601-f978-44d5-8ec2-aacfa505f4d4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:56.683197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:56.713308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5576a-ab84-49b2-83ec-255591b7a45a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:56.713500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5576a-ab84-49b2-83ec-255591b7a45a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:56.713768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5576a-ab84-49b2-83ec-255591b7a45a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:56.715165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 420/835] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:14:56.721472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc729-5d82-40d6-9842-4e34de985e75 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:56.721750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc729-5d82-40d6-9842-4e34de985e75 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:56.722034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc729-5d82-40d6-9842-4e34de985e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:56.732650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc8601-f978-44d5-8ec2-aacfa505f4d4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:56.743411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-00bdc729-5d82-40d6-9842-4e34de985e75 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:56.744508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-00bdc729-5d82-40d6-9842-4e34de985e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:56.772689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210eeb3-24bb-4f12-99fa-8a48112ba48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:56.773397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210eeb3-24bb-4f12-99fa-8a48112ba48d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:56.774370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210eeb3-24bb-4f12-99fa-8a48112ba48d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:56.774370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210eeb3-24bb-4f12-99fa-8a48112ba48d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:56.789366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210eeb3-24bb-4f12-99fa-8a48112ba48d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c210eeb3-24bb-4f12-99fa-8a48112ba48d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:56.794920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:56.795987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:56.796939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 416/836] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:56.802494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210eeb3-24bb-4f12-99fa-8a48112ba48d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:56.825513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:56.837115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 421/837] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:56.855679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc729-5d82-40d6-9842-4e34de985e75 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:56.916196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210eeb3-24bb-4f12-99fa-8a48112ba48d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:56.945368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:56.959237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05337016-5d17-4fd5-9f10-41d2dc74dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:56.960271 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05337016-5d17-4fd5-9f10-41d2dc74dca3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:56.960808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05337016-5d17-4fd5-9f10-41d2dc74dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:56.961237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05337016-5d17-4fd5-9f10-41d2dc74dca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:56.962157 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05337016-5d17-4fd5-9f10-41d2dc74dca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:56.962617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05337016-5d17-4fd5-9f10-41d2dc74dca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:56.964424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05337016-5d17-4fd5-9f10-41d2dc74dca3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:56.975387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 417/838] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:14:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:56.980665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05337016-5d17-4fd5-9f10-41d2dc74dca3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:56.987287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc729-5d82-40d6-9842-4e34de985e75 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.032066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9a88b-0b9a-4454-be03-a1f40465cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.032743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9a88b-0b9a-4454-be03-a1f40465cfaa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.033022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9a88b-0b9a-4454-be03-a1f40465cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.033317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9a88b-0b9a-4454-be03-a1f40465cfaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.048119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9a88b-0b9a-4454-be03-a1f40465cfaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-73b9a88b-0b9a-4454-be03-a1f40465cfaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:14:57.055020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:57.056227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:57.057351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 422/839] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:57.063278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9a88b-0b9a-4454-be03-a1f40465cfaa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.111501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05337016-5d17-4fd5-9f10-41d2dc74dca3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.133953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:57.152155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65228c-a78f-4d64-9331-fc9be098afef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.153388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65228c-a78f-4d64-9331-fc9be098afef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.153926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65228c-a78f-4d64-9331-fc9be098afef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.154449 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65228c-a78f-4d64-9331-fc9be098afef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.166334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65228c-a78f-4d64-9331-fc9be098afef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:57.168340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65228c-a78f-4d64-9331-fc9be098afef None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:57.176794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9a88b-0b9a-4454-be03-a1f40465cfaa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2a65228c-a78f-4d64-9331-fc9be098afef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:57.185609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:57.186584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:57.187498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:57.187498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:57.187498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:57.187498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:57.189884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 418/840] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:14:57.195130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65228c-a78f-4d64-9331-fc9be098afef None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.217308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716ef25-47aa-4bc0-905a-66a02f4608e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.218256 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716ef25-47aa-4bc0-905a-66a02f4608e0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.218542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716ef25-47aa-4bc0-905a-66a02f4608e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.218815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716ef25-47aa-4bc0-905a-66a02f4608e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.219552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716ef25-47aa-4bc0-905a-66a02f4608e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:57.219861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716ef25-47aa-4bc0-905a-66a02f4608e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:57.221255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716ef25-47aa-4bc0-905a-66a02f4608e0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:57.236014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 423/841] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:57.236331 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716ef25-47aa-4bc0-905a-66a02f4608e0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.241536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:57.307856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65228c-a78f-4d64-9331-fc9be098afef None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.343338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f10a3-9d92-4256-85a1-9ae376cb9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.343969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f10a3-9d92-4256-85a1-9ae376cb9a42 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.344262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f10a3-9d92-4256-85a1-9ae376cb9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.344500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f10a3-9d92-4256-85a1-9ae376cb9a42 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.345191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f10a3-9d92-4256-85a1-9ae376cb9a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:57.345538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f10a3-9d92-4256-85a1-9ae376cb9a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:57.347034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f10a3-9d92-4256-85a1-9ae376cb9a42 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:57.347993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716ef25-47aa-4bc0-905a-66a02f4608e0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.359503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 419/842] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:57.360782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582d436-7d1d-4cce-88d6-1f94fabe2697 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.361063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582d436-7d1d-4cce-88d6-1f94fabe2697 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.361366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582d436-7d1d-4cce-88d6-1f94fabe2697 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.366588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 420/843] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:57.366588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582d436-7d1d-4cce-88d6-1f94fabe2697 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.376255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:57.399805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379316c-d998-413e-8f44-58cf187afe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.400432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379316c-d998-413e-8f44-58cf187afe5e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.400729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379316c-d998-413e-8f44-58cf187afe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.400973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379316c-d998-413e-8f44-58cf187afe5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.413218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379316c-d998-413e-8f44-58cf187afe5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:57.414764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379316c-d998-413e-8f44-58cf187afe5e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e379316c-d998-413e-8f44-58cf187afe5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:57.433998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:57.434997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:57.436021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:57.436021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:57.436021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:57.436021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:57.436021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 424/844] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:57.436724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ca62e-d6d9-43fd-9641-6507cf2f4268 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.436829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ca62e-d6d9-43fd-9641-6507cf2f4268 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.437050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ca62e-d6d9-43fd-9641-6507cf2f4268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.455813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-198ca62e-d6d9-43fd-9641-6507cf2f4268 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:57.457085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-198ca62e-d6d9-43fd-9641-6507cf2f4268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:57.486032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:57.492461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582d436-7d1d-4cce-88d6-1f94fabe2697 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.533308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 425/845] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:57.533308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ca62e-d6d9-43fd-9641-6507cf2f4268 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.536894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03539f-9aa4-4f77-9ce1-8002235e4e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.538030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03539f-9aa4-4f77-9ce1-8002235e4e65 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.538317 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03539f-9aa4-4f77-9ce1-8002235e4e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.538596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03539f-9aa4-4f77-9ce1-8002235e4e65 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.550414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03539f-9aa4-4f77-9ce1-8002235e4e65 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:57.551877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03539f-9aa4-4f77-9ce1-8002235e4e65 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1d03539f-9aa4-4f77-9ce1-8002235e4e65 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:57.564163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:57.565253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:14:57.566460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:57.570540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 421/846] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:57.571348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03539f-9aa4-4f77-9ce1-8002235e4e65 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.642639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ca62e-d6d9-43fd-9641-6507cf2f4268 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.644307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:57.680577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a659bd0-06d4-4d01-b5ca-ffa1f6fd8fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.681212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659bd0-06d4-4d01-b5ca-ffa1f6fd8fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.681533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659bd0-06d4-4d01-b5ca-ffa1f6fd8fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.681803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659bd0-06d4-4d01-b5ca-ffa1f6fd8fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.682509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a659bd0-06d4-4d01-b5ca-ffa1f6fd8fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:57.682812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a659bd0-06d4-4d01-b5ca-ffa1f6fd8fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:57.683322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03539f-9aa4-4f77-9ce1-8002235e4e65 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.684188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a659bd0-06d4-4d01-b5ca-ffa1f6fd8fc5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:57.696943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 426/847] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:57.697924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a659bd0-06d4-4d01-b5ca-ffa1f6fd8fc5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.727558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c1d7-fec4-46b2-a352-46e2b4012f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.728250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c1d7-fec4-46b2-a352-46e2b4012f4f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.728524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c1d7-fec4-46b2-a352-46e2b4012f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.728804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c1d7-fec4-46b2-a352-46e2b4012f4f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.729472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32c1d7-fec4-46b2-a352-46e2b4012f4f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:57.730918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32c1d7-fec4-46b2-a352-46e2b4012f4f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ff32c1d7-fec4-46b2-a352-46e2b4012f4f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:57.741009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:57.742188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:57.743093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 422/848] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:57.743932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c1d7-fec4-46b2-a352-46e2b4012f4f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.774810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:57.808835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a659bd0-06d4-4d01-b5ca-ffa1f6fd8fc5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.845150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da6d38-680b-40ce-819b-097bc5176ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.845919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6d38-680b-40ce-819b-097bc5176ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.846200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6d38-680b-40ce-819b-097bc5176ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.846593 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6d38-680b-40ce-819b-097bc5176ed0 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.847399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da6d38-680b-40ce-819b-097bc5176ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:57.847710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da6d38-680b-40ce-819b-097bc5176ed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:57.849153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da6d38-680b-40ce-819b-097bc5176ed0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:57.860518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c1d7-fec4-46b2-a352-46e2b4012f4f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:57.866804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 427/849] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:57.867649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da6d38-680b-40ce-819b-097bc5176ed0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.894076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:57.903581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dbee4-d97b-4b91-8c93-63f98d099617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:57.904196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dbee4-d97b-4b91-8c93-63f98d099617 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:57.904464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dbee4-d97b-4b91-8c93-63f98d099617 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:57.904926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dbee4-d97b-4b91-8c93-63f98d099617 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:57.913170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dbee4-d97b-4b91-8c93-63f98d099617 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:57.914633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dbee4-d97b-4b91-8c93-63f98d099617 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ae6dbee4-d97b-4b91-8c93-63f98d099617 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:14:57.926738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:57.927729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 423/850] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:57.928823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dbee4-d97b-4b91-8c93-63f98d099617 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:57.982540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da6d38-680b-40ce-819b-097bc5176ed0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:58.017005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819588-d977-4de4-9d5f-b214406d7424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:58.017563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819588-d977-4de4-9d5f-b214406d7424 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.017837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819588-d977-4de4-9d5f-b214406d7424 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.018104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819588-d977-4de4-9d5f-b214406d7424 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.018832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f819588-d977-4de4-9d5f-b214406d7424 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:58.019073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:58.019199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f819588-d977-4de4-9d5f-b214406d7424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:58.020472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f819588-d977-4de4-9d5f-b214406d7424 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:58.029508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 428/851] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:58.029508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819588-d977-4de4-9d5f-b214406d7424 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:58.043965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dbee4-d97b-4b91-8c93-63f98d099617 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:58.089835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4218adb-c373-4904-a5bc-1e9d972da1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:58.090497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4218adb-c373-4904-a5bc-1e9d972da1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.090774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4218adb-c373-4904-a5bc-1e9d972da1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.091046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4218adb-c373-4904-a5bc-1e9d972da1b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.118621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:58.136329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819588-d977-4de4-9d5f-b214406d7424 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:58.175415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4218adb-c373-4904-a5bc-1e9d972da1b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:58.176567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cc78d-4860-4e9d-85c5-8b66f63eb626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:58.176898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4218adb-c373-4904-a5bc-1e9d972da1b4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:58.177207 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cc78d-4860-4e9d-85c5-8b66f63eb626 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.177519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cc78d-4860-4e9d-85c5-8b66f63eb626 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.177792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cc78d-4860-4e9d-85c5-8b66f63eb626 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.178609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cc78d-4860-4e9d-85c5-8b66f63eb626 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:58.178924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cc78d-4860-4e9d-85c5-8b66f63eb626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:58.180384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cc78d-4860-4e9d-85c5-8b66f63eb626 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:58.200348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 429/852] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 26 07:14:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:58.201286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cc78d-4860-4e9d-85c5-8b66f63eb626 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:58.279417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:58.302449 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 424/853] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:14:58.303380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4218adb-c373-4904-a5bc-1e9d972da1b4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:58.315245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cc78d-4860-4e9d-85c5-8b66f63eb626 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:58.353317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb8b06-029f-4622-9315-3c6e2e0e97da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:58.353939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb8b06-029f-4622-9315-3c6e2e0e97da None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.354217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb8b06-029f-4622-9315-3c6e2e0e97da None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.354488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb8b06-029f-4622-9315-3c6e2e0e97da None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.355201 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb8b06-029f-4622-9315-3c6e2e0e97da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:58.355496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb8b06-029f-4622-9315-3c6e2e0e97da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:58.356888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb8b06-029f-4622-9315-3c6e2e0e97da None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:58.362287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 430/854] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:14:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:58.362880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb8b06-029f-4622-9315-3c6e2e0e97da None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:58.372175 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:58.439555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4218adb-c373-4904-a5bc-1e9d972da1b4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:58.482670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb8b06-029f-4622-9315-3c6e2e0e97da None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:58.492621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471cb17-c3d0-4597-8763-5c1cb76c96ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:58.493668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471cb17-c3d0-4597-8763-5c1cb76c96ed None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.494727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471cb17-c3d0-4597-8763-5c1cb76c96ed None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.495210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471cb17-c3d0-4597-8763-5c1cb76c96ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.522252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3b3f9-0571-40dd-838f-15bd30b06c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:58.523091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3b3f9-0571-40dd-838f-15bd30b06c60 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.523429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3b3f9-0571-40dd-838f-15bd30b06c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.524169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3b3f9-0571-40dd-838f-15bd30b06c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.535852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3b3f9-0571-40dd-838f-15bd30b06c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:58.537361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3b3f9-0571-40dd-838f-15bd30b06c60 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6bb3b3f9-0571-40dd-838f-15bd30b06c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:58.554828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:58.555989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:58.557125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:58.557125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:58.557125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:58.557125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:58.558716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 431/855] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:58.559649 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:58.565652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3b3f9-0571-40dd-838f-15bd30b06c60 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:58.587887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471cb17-c3d0-4597-8763-5c1cb76c96ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:58.589480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471cb17-c3d0-4597-8763-5c1cb76c96ed None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:58.636368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:58.683818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3b3f9-0571-40dd-838f-15bd30b06c60 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:58.724771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e5215-99c3-4530-8005-09d644b4934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:58.725468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e5215-99c3-4530-8005-09d644b4934e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.725755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e5215-99c3-4530-8005-09d644b4934e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.726032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e5215-99c3-4530-8005-09d644b4934e None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.726774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e5215-99c3-4530-8005-09d644b4934e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:58.727085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e5215-99c3-4530-8005-09d644b4934e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:58.728406 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 425/856] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:14:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:14:58.728868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e5215-99c3-4530-8005-09d644b4934e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:58.729991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0055f-c0da-4724-a912-81f19b7d6d52 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.730446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0055f-c0da-4724-a912-81f19b7d6d52 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.730575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0055f-c0da-4724-a912-81f19b7d6d52 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.732275 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 426/857] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:14:58.732683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0055f-c0da-4724-a912-81f19b7d6d52 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:58.753110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 432/858] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:58.754799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6809ce-5849-4cba-a557-dd89dede44f2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.754799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6809ce-5849-4cba-a557-dd89dede44f2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.755063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6809ce-5849-4cba-a557-dd89dede44f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.775596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9f6809ce-5849-4cba-a557-dd89dede44f2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:14:58.776595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f6809ce-5849-4cba-a557-dd89dede44f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:14:58.830396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:58.852501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0055f-c0da-4724-a912-81f19b7d6d52 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:58.857732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 433/859] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:14:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:14:58.857732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6809ce-5849-4cba-a557-dd89dede44f2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:58.896834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c174b-de59-4dc4-adb4-eba72aac92f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:58.897826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c174b-de59-4dc4-adb4-eba72aac92f2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:58.898271 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c174b-de59-4dc4-adb4-eba72aac92f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:58.898697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c174b-de59-4dc4-adb4-eba72aac92f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:58.911061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c174b-de59-4dc4-adb4-eba72aac92f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:58.912805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c174b-de59-4dc4-adb4-eba72aac92f2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:58.916926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2f0c174b-de59-4dc4-adb4-eba72aac92f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:14:58.932151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:58.933354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:58.934471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:14:58.934471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:14:58.934471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:14:58.934471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:58.936634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 427/860] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:58.937739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c174b-de59-4dc4-adb4-eba72aac92f2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:58.976530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6809ce-5849-4cba-a557-dd89dede44f2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:59.023056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497bde4-fa14-442e-af87-84a837c18321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:59.023719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497bde4-fa14-442e-af87-84a837c18321 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:59.024002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497bde4-fa14-442e-af87-84a837c18321 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:59.024260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497bde4-fa14-442e-af87-84a837c18321 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:59.035289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497bde4-fa14-442e-af87-84a837c18321 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:59.038396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497bde4-fa14-442e-af87-84a837c18321 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7497bde4-fa14-442e-af87-84a837c18321 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:59.058811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:59.060358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 434/861] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:59.063121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497bde4-fa14-442e-af87-84a837c18321 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:59.072960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c174b-de59-4dc4-adb4-eba72aac92f2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:59.123334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a019c55-6c2e-46cf-b7c6-e547df2d2e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:59.124094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a019c55-6c2e-46cf-b7c6-e547df2d2e00 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:59.124502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a019c55-6c2e-46cf-b7c6-e547df2d2e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:59.124908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a019c55-6c2e-46cf-b7c6-e547df2d2e00 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:59.125745 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a019c55-6c2e-46cf-b7c6-e547df2d2e00 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:59.127494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a019c55-6c2e-46cf-b7c6-e547df2d2e00 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:59.131101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5a019c55-6c2e-46cf-b7c6-e547df2d2e00 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:59.141173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:59.142429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:14:59.143610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:59.147662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 428/862] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jul 26 07:14:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:59.147662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a019c55-6c2e-46cf-b7c6-e547df2d2e00 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:59.216670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497bde4-fa14-442e-af87-84a837c18321 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:59.226529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:59.269237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdd91b-70fa-41ab-a19e-53228b2ad704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:59.269918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdd91b-70fa-41ab-a19e-53228b2ad704 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:59.270219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdd91b-70fa-41ab-a19e-53228b2ad704 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:59.270480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdd91b-70fa-41ab-a19e-53228b2ad704 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:59.271148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdd91b-70fa-41ab-a19e-53228b2ad704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:59.271446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdd91b-70fa-41ab-a19e-53228b2ad704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:59.272836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdd91b-70fa-41ab-a19e-53228b2ad704 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:59.278348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a019c55-6c2e-46cf-b7c6-e547df2d2e00 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:59.288253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 435/863] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:59.293668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdd91b-70fa-41ab-a19e-53228b2ad704 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:59.324508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb05d80-8b4b-4100-ab53-3a4dff61231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:59.324879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb05d80-8b4b-4100-ab53-3a4dff61231c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:59.325142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb05d80-8b4b-4100-ab53-3a4dff61231c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:59.325907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb05d80-8b4b-4100-ab53-3a4dff61231c None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:59.326212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb05d80-8b4b-4100-ab53-3a4dff61231c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:59.326520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb05d80-8b4b-4100-ab53-3a4dff61231c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:59.328005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb05d80-8b4b-4100-ab53-3a4dff61231c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:59.344855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 429/864] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:59.346812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb05d80-8b4b-4100-ab53-3a4dff61231c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:59.415816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:59.419920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdd91b-70fa-41ab-a19e-53228b2ad704 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:59.456760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25e4a1-1ab5-4cee-b4b8-55eba864a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:59.457443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25e4a1-1ab5-4cee-b4b8-55eba864a541 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:59.457719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25e4a1-1ab5-4cee-b4b8-55eba864a541 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:59.457986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25e4a1-1ab5-4cee-b4b8-55eba864a541 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:59.458699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25e4a1-1ab5-4cee-b4b8-55eba864a541 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:59.458979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25e4a1-1ab5-4cee-b4b8-55eba864a541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:59.460374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25e4a1-1ab5-4cee-b4b8-55eba864a541 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:59.467868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 436/865] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:14:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:59.468580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25e4a1-1ab5-4cee-b4b8-55eba864a541 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:59.474688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb05d80-8b4b-4100-ab53-3a4dff61231c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:59.518588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:59.523278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f22b-cc98-4d8f-939a-fdc1e3fa41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:59.523972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f22b-cc98-4d8f-939a-fdc1e3fa41c9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:59.524257 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f22b-cc98-4d8f-939a-fdc1e3fa41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:59.524530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f22b-cc98-4d8f-939a-fdc1e3fa41c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:59.537451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70f22b-cc98-4d8f-939a-fdc1e3fa41c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:59.539211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70f22b-cc98-4d8f-939a-fdc1e3fa41c9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ae70f22b-cc98-4d8f-939a-fdc1e3fa41c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:14:59.554185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:14:59.555310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 430/866] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:14:59.556243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f22b-cc98-4d8f-939a-fdc1e3fa41c9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:59.621451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25e4a1-1ab5-4cee-b4b8-55eba864a541 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:59.663343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f649a5c-394d-401e-8abf-ed7f4afe7346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:59.664095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649a5c-394d-401e-8abf-ed7f4afe7346 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:59.664396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649a5c-394d-401e-8abf-ed7f4afe7346 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:59.664645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649a5c-394d-401e-8abf-ed7f4afe7346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:59.665500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f649a5c-394d-401e-8abf-ed7f4afe7346 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=b5a03e5f2dee4bdeac26236d8127588c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:59.665798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f649a5c-394d-401e-8abf-ed7f4afe7346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:59.667340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f649a5c-394d-401e-8abf-ed7f4afe7346 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:59.674488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 437/867] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:59 2022] GET /identity/v3/role_assignments?user.id=b5a03e5f2dee4bdeac26236d8127588c&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:59.675418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f649a5c-394d-401e-8abf-ed7f4afe7346 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:14:59.695896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f22b-cc98-4d8f-939a-fdc1e3fa41c9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:59.727620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:59.756617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b5fb7-9549-4d52-ac0e-a12d63febc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:59.758597 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5fb7-9549-4d52-ac0e-a12d63febc60 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:59.759759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5fb7-9549-4d52-ac0e-a12d63febc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:59.760205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5fb7-9549-4d52-ac0e-a12d63febc60 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:59.761443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b5fb7-9549-4d52-ac0e-a12d63febc60 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:59.762504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b5fb7-9549-4d52-ac0e-a12d63febc60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:59.764934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b5fb7-9549-4d52-ac0e-a12d63febc60 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:59.771801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 431/868] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:14:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:59.829518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:14:59.837290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f649a5c-394d-401e-8abf-ed7f4afe7346 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:14:59.879819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64088b-78b0-4455-a71f-e0111bf427ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:14:59.880490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64088b-78b0-4455-a71f-e0111bf427ca None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:14:59.880770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64088b-78b0-4455-a71f-e0111bf427ca None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:14:59.881046 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64088b-78b0-4455-a71f-e0111bf427ca None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:14:59.881874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64088b-78b0-4455-a71f-e0111bf427ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:14:59.882181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64088b-78b0-4455-a71f-e0111bf427ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:14:59.883678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64088b-78b0-4455-a71f-e0111bf427ca None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:14:59.903149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 438/869] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:14:59.905059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b5fb7-9549-4d52-ac0e-a12d63febc60 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:00.015562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b5fb7-9549-4d52-ac0e-a12d63febc60 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:00.053177 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11e5c8-84e3-4a13-ac5a-85589bfc1a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:00.053845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e5c8-84e3-4a13-ac5a-85589bfc1a1c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:00.054124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e5c8-84e3-4a13-ac5a-85589bfc1a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:00.054396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e5c8-84e3-4a13-ac5a-85589bfc1a1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:00.055197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11e5c8-84e3-4a13-ac5a-85589bfc1a1c None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=53d237d0049541999d292b88d851e95a) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:00.055503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11e5c8-84e3-4a13-ac5a-85589bfc1a1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:00.056925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11e5c8-84e3-4a13-ac5a-85589bfc1a1c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:00.063457 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 432/870] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:14:59 2022] GET /identity/v3/role_assignments?user.id=53d237d0049541999d292b88d851e95a&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:00.458108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600261-7d9a-474f-86cd-54804de2bef6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:00.458510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600261-7d9a-474f-86cd-54804de2bef6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:00.458688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600261-7d9a-474f-86cd-54804de2bef6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:00.460335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 439/871] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:00.465910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2f849-05b6-4856-94bd-2fd5d89f3810 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:00.466191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2f849-05b6-4856-94bd-2fd5d89f3810 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:00.466463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2f849-05b6-4856-94bd-2fd5d89f3810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:00.485466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c2d2f849-05b6-4856-94bd-2fd5d89f3810 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:00.486740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c2d2f849-05b6-4856-94bd-2fd5d89f3810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:00.532229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:00.565895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 433/872] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:00.588270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46600261-7d9a-474f-86cd-54804de2bef6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:00.701291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46600261-7d9a-474f-86cd-54804de2bef6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:00.739635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec973a-2a3a-462c-9585-4f1c04cd053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:00.740191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec973a-2a3a-462c-9585-4f1c04cd053c None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:00.740472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec973a-2a3a-462c-9585-4f1c04cd053c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:00.740745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec973a-2a3a-462c-9585-4f1c04cd053c None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:00.741491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec973a-2a3a-462c-9585-4f1c04cd053c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:00.742883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec973a-2a3a-462c-9585-4f1c04cd053c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:00.761830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 440/873] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:15:00 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:01.804787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186a69c-e3c7-4f57-91fe-e832908c2897 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:01.805340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186a69c-e3c7-4f57-91fe-e832908c2897 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:01.805340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186a69c-e3c7-4f57-91fe-e832908c2897 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:01.807039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 434/874] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:01.812488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4eed-7126-4bf3-ba91-9bc2b98098ad None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:01.812936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4eed-7126-4bf3-ba91-9bc2b98098ad None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:01.813034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4eed-7126-4bf3-ba91-9bc2b98098ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:01.832836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bbca4eed-7126-4bf3-ba91-9bc2b98098ad None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:01.834102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bbca4eed-7126-4bf3-ba91-9bc2b98098ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:01.847888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:01.877797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadec0d3-0bba-405b-bb90-c11b207f63fa None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:01.878137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadec0d3-0bba-405b-bb90-c11b207f63fa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:01.878349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadec0d3-0bba-405b-bb90-c11b207f63fa None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:01.879793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 435/875] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:01.885740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b56e-9fda-434f-8055-03d2b6d98ac9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:01.885919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b56e-9fda-434f-8055-03d2b6d98ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:01.886317 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b56e-9fda-434f-8055-03d2b6d98ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:01.906656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8e19b56e-9fda-434f-8055-03d2b6d98ac9 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:01.908023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8e19b56e-9fda-434f-8055-03d2b6d98ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:01.926718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 441/876] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:01.948758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca4eed-7126-4bf3-ba91-9bc2b98098ad None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:02.001698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 436/877] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:02.024816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19b56e-9fda-434f-8055-03d2b6d98ac9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:02.071805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca4eed-7126-4bf3-ba91-9bc2b98098ad None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:02.118423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1cc4d-14f3-4b7a-a042-ca0dd065a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:02.119475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1cc4d-14f3-4b7a-a042-ca0dd065a681 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.120465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1cc4d-14f3-4b7a-a042-ca0dd065a681 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.120941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1cc4d-14f3-4b7a-a042-ca0dd065a681 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.121842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1cc4d-14f3-4b7a-a042-ca0dd065a681 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:02.124274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1cc4d-14f3-4b7a-a042-ca0dd065a681 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-98b1cc4d-14f3-4b7a-a042-ca0dd065a681 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:02.136588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:02.137699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:02.138566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:02.140148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 442/878] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:15:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:02.148303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1cc4d-14f3-4b7a-a042-ca0dd065a681 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:02.154330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19b56e-9fda-434f-8055-03d2b6d98ac9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:02.160252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:02.164864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:02.201111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca9e94-c7e3-4eac-a3f6-8e0d9ced2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:02.201785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca9e94-c7e3-4eac-a3f6-8e0d9ced2d0a None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.202069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca9e94-c7e3-4eac-a3f6-8e0d9ced2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.202346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca9e94-c7e3-4eac-a3f6-8e0d9ced2d0a None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.203064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca9e94-c7e3-4eac-a3f6-8e0d9ced2d0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:02.204499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca9e94-c7e3-4eac-a3f6-8e0d9ced2d0a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:02.228859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 437/879] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:15:02 2022] POST /identity/v3/services => generated 269 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:15:02.228859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4f0a1-4084-4355-874d-b8dd03475de8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.228859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4f0a1-4084-4355-874d-b8dd03475de8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.228859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4f0a1-4084-4355-874d-b8dd03475de8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.228859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 438/880] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:02.234866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc82a8-8500-41be-8f2e-5f23c8107c8c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.235234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc82a8-8500-41be-8f2e-5f23c8107c8c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.235465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc82a8-8500-41be-8f2e-5f23c8107c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.256351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d8cc82a8-8500-41be-8f2e-5f23c8107c8c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:02.257668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d8cc82a8-8500-41be-8f2e-5f23c8107c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:02.284667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1cc4d-14f3-4b7a-a042-ca0dd065a681 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:02.331312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684960-ba56-4079-9f70-d95162c775ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:02.332323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684960-ba56-4079-9f70-d95162c775ea None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.332821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684960-ba56-4079-9f70-d95162c775ea None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.333283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684960-ba56-4079-9f70-d95162c775ea None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.334222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f684960-ba56-4079-9f70-d95162c775ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:02.334540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f684960-ba56-4079-9f70-d95162c775ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:02.336102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f684960-ba56-4079-9f70-d95162c775ea None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:02.342127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 443/881] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:02.343525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 439/882] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:02.354441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684960-ba56-4079-9f70-d95162c775ea None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:02.371487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc82a8-8500-41be-8f2e-5f23c8107c8c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:02.433957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:02.484330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684960-ba56-4079-9f70-d95162c775ea None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:02.503265 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:02.511902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc82a8-8500-41be-8f2e-5f23c8107c8c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:02.524103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927ea18-25a2-4ada-9802-e20f86402180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:02.524720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927ea18-25a2-4ada-9802-e20f86402180 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.524999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927ea18-25a2-4ada-9802-e20f86402180 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.525292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927ea18-25a2-4ada-9802-e20f86402180 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.525988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927ea18-25a2-4ada-9802-e20f86402180 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:02.526291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927ea18-25a2-4ada-9802-e20f86402180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:02.527804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927ea18-25a2-4ada-9802-e20f86402180 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:02.533177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 444/883] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:02.555721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f5ab8-200a-464c-b478-d9930ccc11a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:02.556814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f5ab8-200a-464c-b478-d9930ccc11a4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.557356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f5ab8-200a-464c-b478-d9930ccc11a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.557853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f5ab8-200a-464c-b478-d9930ccc11a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.571056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f5ab8-200a-464c-b478-d9930ccc11a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3c4f5ab8-200a-464c-b478-d9930ccc11a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:02.576739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:02.577888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:02.578967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:02.585408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 440/884] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 26 07:15:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:02.588228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927ea18-25a2-4ada-9802-e20f86402180 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:02.705159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927ea18-25a2-4ada-9802-e20f86402180 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:02.737244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:02.745103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a81c-b8c8-4b15-9873-031cb282377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:02.745780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a81c-b8c8-4b15-9873-031cb282377c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.746061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a81c-b8c8-4b15-9873-031cb282377c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.746337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a81c-b8c8-4b15-9873-031cb282377c None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.747075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272a81c-b8c8-4b15-9873-031cb282377c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:02.747380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272a81c-b8c8-4b15-9873-031cb282377c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:02.748774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272a81c-b8c8-4b15-9873-031cb282377c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:02.761442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 445/885] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 26 07:15:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:02.764233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f5ab8-200a-464c-b478-d9930ccc11a4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:02.834464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765989d1-9c7a-4668-b726-b30f06ca7e3c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.835498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765989d1-9c7a-4668-b726-b30f06ca7e3c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.835989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765989d1-9c7a-4668-b726-b30f06ca7e3c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.838008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 446/886] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:02.844582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ad4c0-ba56-4261-82e9-7f478db082d1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.845220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ad4c0-ba56-4261-82e9-7f478db082d1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.845751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ad4c0-ba56-4261-82e9-7f478db082d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.870174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ac1ad4c0-ba56-4261-82e9-7f478db082d1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:02.871537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ac1ad4c0-ba56-4261-82e9-7f478db082d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:02.884779 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f5ab8-200a-464c-b478-d9930ccc11a4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:02.923554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5fd50-c2aa-4016-ab77-c04552426483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:02.924221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5fd50-c2aa-4016-ab77-c04552426483 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:02.924576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5fd50-c2aa-4016-ab77-c04552426483 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:02.924943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5fd50-c2aa-4016-ab77-c04552426483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:02.937836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5fd50-c2aa-4016-ab77-c04552426483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:02.939519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5fd50-c2aa-4016-ab77-c04552426483 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:02.952594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 447/887] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6cd5fd50-c2aa-4016-ab77-c04552426483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:02.956776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:02.957946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:02.959093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:02.959093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:02.959093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:02.959093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:02.959093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 441/888] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:02.963800 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ad4c0-ba56-4261-82e9-7f478db082d1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:02.978967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5fd50-c2aa-4016-ab77-c04552426483 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:02.991614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:03.092917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ad4c0-ba56-4261-82e9-7f478db082d1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:03.115143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5fd50-c2aa-4016-ab77-c04552426483 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:03.122700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:03.137042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7ff7b-dee5-408a-a32f-00eb917bec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:03.137707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7ff7b-dee5-408a-a32f-00eb917bec94 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:03.137983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7ff7b-dee5-408a-a32f-00eb917bec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:03.138250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7ff7b-dee5-408a-a32f-00eb917bec94 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:03.138966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7ff7b-dee5-408a-a32f-00eb917bec94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:03.139255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7ff7b-dee5-408a-a32f-00eb917bec94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:03.140657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7ff7b-dee5-408a-a32f-00eb917bec94 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:03.158710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 448/889] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:03.159777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7ff7b-dee5-408a-a32f-00eb917bec94 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:03.163234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d46d-67ec-46a9-b2e9-93f1310ba549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:03.165171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d46d-67ec-46a9-b2e9-93f1310ba549 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:03.165703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d46d-67ec-46a9-b2e9-93f1310ba549 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:03.166329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d46d-67ec-46a9-b2e9-93f1310ba549 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:03.167193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483d46d-67ec-46a9-b2e9-93f1310ba549 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:03.168877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483d46d-67ec-46a9-b2e9-93f1310ba549 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a483d46d-67ec-46a9-b2e9-93f1310ba549 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:03.180982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:03.182863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:03.183746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 442/890] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:15:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:03.190795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d46d-67ec-46a9-b2e9-93f1310ba549 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:03.277348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:03.294830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7ff7b-dee5-408a-a32f-00eb917bec94 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:03.322358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d46d-67ec-46a9-b2e9-93f1310ba549 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:03.339232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deb1d8-1db6-426f-af7a-7ce00b3e2aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:03.339894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deb1d8-1db6-426f-af7a-7ce00b3e2aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:03.340168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deb1d8-1db6-426f-af7a-7ce00b3e2aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:03.340434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deb1d8-1db6-426f-af7a-7ce00b3e2aa9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:03.350376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deb1d8-1db6-426f-af7a-7ce00b3e2aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:03.351455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deb1d8-1db6-426f-af7a-7ce00b3e2aa9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-44deb1d8-1db6-426f-af7a-7ce00b3e2aa9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:15:03.364476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:03.365559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:15:03.366557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:03.369865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5029b-7ce3-4e15-a1b3-ad5351abee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:03.370605 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 449/891] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:15:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:03.371109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5029b-7ce3-4e15-a1b3-ad5351abee7c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:03.371545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deb1d8-1db6-426f-af7a-7ce00b3e2aa9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:03.371795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5029b-7ce3-4e15-a1b3-ad5351abee7c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:03.372263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5029b-7ce3-4e15-a1b3-ad5351abee7c None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:03.373160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5029b-7ce3-4e15-a1b3-ad5351abee7c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:03.373693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5029b-7ce3-4e15-a1b3-ad5351abee7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:03.376485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5029b-7ce3-4e15-a1b3-ad5351abee7c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:03.388083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 443/892] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:15:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:03.390311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5029b-7ce3-4e15-a1b3-ad5351abee7c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:03.440692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:03.509303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deb1d8-1db6-426f-af7a-7ce00b3e2aa9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:03.531809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5029b-7ce3-4e15-a1b3-ad5351abee7c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:03.544225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f1bb-3b50-47e1-9d11-49e4d183416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:03.544962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f1bb-3b50-47e1-9d11-49e4d183416d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:03.545528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f1bb-3b50-47e1-9d11-49e4d183416d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:03.545735 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f1bb-3b50-47e1-9d11-49e4d183416d None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:03.546627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44f1bb-3b50-47e1-9d11-49e4d183416d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:03.547049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44f1bb-3b50-47e1-9d11-49e4d183416d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:03.548611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44f1bb-3b50-47e1-9d11-49e4d183416d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:03.570981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 450/893] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 26 07:15:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:03.571904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f1bb-3b50-47e1-9d11-49e4d183416d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:03.574134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee795c-f5b5-4e99-8c12-a52bfba3a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:03.575174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee795c-f5b5-4e99-8c12-a52bfba3a04f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:03.576379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee795c-f5b5-4e99-8c12-a52bfba3a04f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:03.576825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee795c-f5b5-4e99-8c12-a52bfba3a04f None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:03.577731 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee795c-f5b5-4e99-8c12-a52bfba3a04f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:03.578210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee795c-f5b5-4e99-8c12-a52bfba3a04f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:03.579792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee795c-f5b5-4e99-8c12-a52bfba3a04f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:03.582685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:03.587420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 444/894] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:15:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:03.593641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee795c-f5b5-4e99-8c12-a52bfba3a04f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:03.674909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:03.680909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f1bb-3b50-47e1-9d11-49e4d183416d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:03.722064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee795c-f5b5-4e99-8c12-a52bfba3a04f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:03.724522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33689462-fb60-4841-9fa0-32360eb80754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:03.726245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33689462-fb60-4841-9fa0-32360eb80754 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:03.726535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33689462-fb60-4841-9fa0-32360eb80754 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:03.726806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33689462-fb60-4841-9fa0-32360eb80754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:03.760457 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be73ff-08de-40d0-8e5f-2b06b0c2879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:03.761244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be73ff-08de-40d0-8e5f-2b06b0c2879d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:03.761734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be73ff-08de-40d0-8e5f-2b06b0c2879d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:03.762098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be73ff-08de-40d0-8e5f-2b06b0c2879d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:03.763045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be73ff-08de-40d0-8e5f-2b06b0c2879d None admin] RBAC: Adding query filter params (interface=public, service_id=6283baed594249d99efc00f73c6417cc, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:03.763465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be73ff-08de-40d0-8e5f-2b06b0c2879d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:03.765081 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be73ff-08de-40d0-8e5f-2b06b0c2879d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:03.771271 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 445/895] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 26 07:15:03 2022] GET /identity/v3/endpoints?service_id=6283baed594249d99efc00f73c6417cc&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:03.776376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be73ff-08de-40d0-8e5f-2b06b0c2879d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:03.811591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33689462-fb60-4841-9fa0-32360eb80754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:03.814304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33689462-fb60-4841-9fa0-32360eb80754 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:03.841785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:03.895305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be73ff-08de-40d0-8e5f-2b06b0c2879d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:03.927314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 451/896] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:03 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:15:03.929696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:03.934784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33689462-fb60-4841-9fa0-32360eb80754 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:03.940871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07535-a270-4f51-85a8-38119fe21ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:03.941544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07535-a270-4f51-85a8-38119fe21ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:03.941825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07535-a270-4f51-85a8-38119fe21ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:03.942098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07535-a270-4f51-85a8-38119fe21ba6 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:03.942768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f07535-a270-4f51-85a8-38119fe21ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:03.944250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f07535-a270-4f51-85a8-38119fe21ba6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:03.956116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 446/897] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 26 07:15:03 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:15:04.046696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33689462-fb60-4841-9fa0-32360eb80754 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:04.084649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e8060-fc95-46be-b1e6-71a8324d0cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:04.085231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e8060-fc95-46be-b1e6-71a8324d0cdc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.085540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e8060-fc95-46be-b1e6-71a8324d0cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.085810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e8060-fc95-46be-b1e6-71a8324d0cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.098004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e8060-fc95-46be-b1e6-71a8324d0cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:04.099560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e8060-fc95-46be-b1e6-71a8324d0cdc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a26e8060-fc95-46be-b1e6-71a8324d0cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:04.116060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:04.118427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:04.120634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:04.120634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:04.120634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:04.120634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:04.120634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 452/898] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:04.124186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07535-a270-4f51-85a8-38119fe21ba6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:04.231838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07535-a270-4f51-85a8-38119fe21ba6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:04.263840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:04.272955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0fd8b-6f81-4633-8e98-0fdbbfa59ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:04.273616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fd8b-6f81-4633-8e98-0fdbbfa59ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.273893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fd8b-6f81-4633-8e98-0fdbbfa59ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.274161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fd8b-6f81-4633-8e98-0fdbbfa59ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.274863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0fd8b-6f81-4633-8e98-0fdbbfa59ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:04.275162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0fd8b-6f81-4633-8e98-0fdbbfa59ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:04.276519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0fd8b-6f81-4633-8e98-0fdbbfa59ac6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:04.289278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 447/899] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:04.294949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e8060-fc95-46be-b1e6-71a8324d0cdc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:04.351191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:04.391659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36913735-ca80-44c6-9419-73f6e1df14cd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.392001 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36913735-ca80-44c6-9419-73f6e1df14cd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.392210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36913735-ca80-44c6-9419-73f6e1df14cd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.394074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 448/900] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:04.398796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b2ce3-bba7-4930-ab9d-0d46716c6e21 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.399077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b2ce3-bba7-4930-ab9d-0d46716c6e21 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.399349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b2ce3-bba7-4930-ab9d-0d46716c6e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.399585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e8060-fc95-46be-b1e6-71a8324d0cdc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:04.417381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fd3b2ce3-bba7-4930-ab9d-0d46716c6e21 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:04.418602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fd3b2ce3-bba7-4930-ab9d-0d46716c6e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:04.444701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8671aeb-c83c-4b8e-9ec6-540e89cd1ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:04.445786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8671aeb-c83c-4b8e-9ec6-540e89cd1ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.446309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8671aeb-c83c-4b8e-9ec6-540e89cd1ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.446585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8671aeb-c83c-4b8e-9ec6-540e89cd1ef1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.455616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8671aeb-c83c-4b8e-9ec6-540e89cd1ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:04.458272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8671aeb-c83c-4b8e-9ec6-540e89cd1ef1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e8671aeb-c83c-4b8e-9ec6-540e89cd1ef1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:15:04.473752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:04.474736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:04.475877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:15:04.475877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:15:04.475877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:15:04.475877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:15:04.475877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:15:04.475877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:15:04.475877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:04.475877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:04.475877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 453/901] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:04.480913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8671aeb-c83c-4b8e-9ec6-540e89cd1ef1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:04.492437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 449/902] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:04.514522 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b2ce3-bba7-4930-ab9d-0d46716c6e21 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:04.586169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8671aeb-c83c-4b8e-9ec6-540e89cd1ef1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:04.599774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:04.619022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b2ce3-bba7-4930-ab9d-0d46716c6e21 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:04.622583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27ec68-6a5b-4b3b-9462-fd4ad5636338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:04.623221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ec68-6a5b-4b3b-9462-fd4ad5636338 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.623503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ec68-6a5b-4b3b-9462-fd4ad5636338 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.623778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ec68-6a5b-4b3b-9462-fd4ad5636338 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.624538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27ec68-6a5b-4b3b-9462-fd4ad5636338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:04.624843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27ec68-6a5b-4b3b-9462-fd4ad5636338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:04.626326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27ec68-6a5b-4b3b-9462-fd4ad5636338 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:04.637729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:04.643806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 454/903] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:04.644855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27ec68-6a5b-4b3b-9462-fd4ad5636338 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:04.659438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c0863-7675-4ed1-b397-97f53df74707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:04.660117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c0863-7675-4ed1-b397-97f53df74707 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.660376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c0863-7675-4ed1-b397-97f53df74707 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.660647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c0863-7675-4ed1-b397-97f53df74707 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.661623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c0863-7675-4ed1-b397-97f53df74707 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:04.663252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c0863-7675-4ed1-b397-97f53df74707 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f90c0863-7675-4ed1-b397-97f53df74707 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:04.674093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:04.675149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:04.676034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 450/904] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jul 26 07:15:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:04.676913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952390a7-dd84-4960-87b7-dafc91624044 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.677676 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952390a7-dd84-4960-87b7-dafc91624044 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.677676 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952390a7-dd84-4960-87b7-dafc91624044 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.678731 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 451/905] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:04.683140 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952390a7-dd84-4960-87b7-dafc91624044 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:04.765344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27ec68-6a5b-4b3b-9462-fd4ad5636338 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:04.787383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952390a7-dd84-4960-87b7-dafc91624044 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:04.800512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcea479-9dbe-48ca-aa29-5fcf53ddfb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:04.801131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcea479-9dbe-48ca-aa29-5fcf53ddfb00 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.801445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcea479-9dbe-48ca-aa29-5fcf53ddfb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.801705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcea479-9dbe-48ca-aa29-5fcf53ddfb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.802528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcea479-9dbe-48ca-aa29-5fcf53ddfb00 None admin] RBAC: Adding query filter params (role.id=aff1b21495a74c7fa12170715d44de2d, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=53d237d0049541999d292b88d851e95a) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:04.802837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcea479-9dbe-48ca-aa29-5fcf53ddfb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:04.804262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcea479-9dbe-48ca-aa29-5fcf53ddfb00 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:04.809959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 455/906] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:15:04 2022] GET /identity/v3/role_assignments?user.id=53d237d0049541999d292b88d851e95a&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=aff1b21495a74c7fa12170715d44de2d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:04.815887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8adb65-0f7b-448f-9464-2300aba48bed None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.816652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8adb65-0f7b-448f-9464-2300aba48bed None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.817662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8adb65-0f7b-448f-9464-2300aba48bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.833574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d87f8-9bd4-4046-a249-36ffcaf23b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:04.834642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d87f8-9bd4-4046-a249-36ffcaf23b64 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:04.835188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d87f8-9bd4-4046-a249-36ffcaf23b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:04.836457 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d87f8-9bd4-4046-a249-36ffcaf23b64 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:04.837497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d87f8-9bd4-4046-a249-36ffcaf23b64 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:04.838258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d87f8-9bd4-4046-a249-36ffcaf23b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:04.840046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d87f8-9bd4-4046-a249-36ffcaf23b64 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:04.843315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cc8adb65-0f7b-448f-9464-2300aba48bed None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:04.844835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cc8adb65-0f7b-448f-9464-2300aba48bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:04.847581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 452/907] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:15:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:04.854361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d87f8-9bd4-4046-a249-36ffcaf23b64 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:04.881897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:04.907078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:04.928231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 456/908] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:04.950059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8adb65-0f7b-448f-9464-2300aba48bed None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:04.970148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d87f8-9bd4-4046-a249-36ffcaf23b64 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:05.014613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b9c2-5145-44c8-a3d9-ed30f2465688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:05.015548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b9c2-5145-44c8-a3d9-ed30f2465688 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:05.015858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b9c2-5145-44c8-a3d9-ed30f2465688 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:05.016344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b9c2-5145-44c8-a3d9-ed30f2465688 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:05.017550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78b9c2-5145-44c8-a3d9-ed30f2465688 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:05.017916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78b9c2-5145-44c8-a3d9-ed30f2465688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:05.019946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78b9c2-5145-44c8-a3d9-ed30f2465688 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:05.027210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 453/909] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:15:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:05.033875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b9c2-5145-44c8-a3d9-ed30f2465688 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:05.067199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8adb65-0f7b-448f-9464-2300aba48bed None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:05.112667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d7512-2e5c-4ef7-afc4-65f97fc2f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:05.113438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d7512-2e5c-4ef7-afc4-65f97fc2f072 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:05.113719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d7512-2e5c-4ef7-afc4-65f97fc2f072 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:05.113992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d7512-2e5c-4ef7-afc4-65f97fc2f072 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:05.114717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d7512-2e5c-4ef7-afc4-65f97fc2f072 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:05.116444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d7512-2e5c-4ef7-afc4-65f97fc2f072 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:05.138700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 457/910] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:15:04 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:15:05.167591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b9c2-5145-44c8-a3d9-ed30f2465688 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:05.180657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:05.214836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5be90-f1df-4c6d-8a17-a9c1af4f544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:05.215573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5be90-f1df-4c6d-8a17-a9c1af4f544e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:05.215862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5be90-f1df-4c6d-8a17-a9c1af4f544e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:05.216134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5be90-f1df-4c6d-8a17-a9c1af4f544e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:05.216954 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5be90-f1df-4c6d-8a17-a9c1af4f544e None admin] RBAC: Adding query filter params (interface=public, service_id=172b930c781645ce8e4e8506222a7fb0, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:05.217688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5be90-f1df-4c6d-8a17-a9c1af4f544e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:05.219153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5be90-f1df-4c6d-8a17-a9c1af4f544e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:05.225943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 454/911] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 26 07:15:05 2022] GET /identity/v3/endpoints?service_id=172b930c781645ce8e4e8506222a7fb0&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:05.231797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d7512-2e5c-4ef7-afc4-65f97fc2f072 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:05.264143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:05.346889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d7512-2e5c-4ef7-afc4-65f97fc2f072 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:05.383171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fef8e-dbbe-462f-a22c-e94ebb56c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:05.383804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fef8e-dbbe-462f-a22c-e94ebb56c886 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:05.384083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fef8e-dbbe-462f-a22c-e94ebb56c886 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:05.384367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fef8e-dbbe-462f-a22c-e94ebb56c886 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:05.385017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fef8e-dbbe-462f-a22c-e94ebb56c886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:05.386526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fef8e-dbbe-462f-a22c-e94ebb56c886 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:05.392997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 458/912] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 26 07:15:05 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:15:06.073609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3572fc-fb52-4b87-9052-d4acdd369c6e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:06.074149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3572fc-fb52-4b87-9052-d4acdd369c6e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:06.074149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3572fc-fb52-4b87-9052-d4acdd369c6e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:06.075812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 455/913] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:06.081326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7f18a-3b3d-4110-8735-0b927b3b531d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:06.081830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7f18a-3b3d-4110-8735-0b927b3b531d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:06.081911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7f18a-3b3d-4110-8735-0b927b3b531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:06.101072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6da7f18a-3b3d-4110-8735-0b927b3b531d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:06.102333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6da7f18a-3b3d-4110-8735-0b927b3b531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:06.200996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 459/914] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:06.238109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3572fc-fb52-4b87-9052-d4acdd369c6e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:06.367078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3572fc-fb52-4b87-9052-d4acdd369c6e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:06.403781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541e80-a4d5-4d7d-b490-5c02debba69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:06.404990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541e80-a4d5-4d7d-b490-5c02debba69a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:06.405493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541e80-a4d5-4d7d-b490-5c02debba69a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:06.406002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541e80-a4d5-4d7d-b490-5c02debba69a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:06.406855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a541e80-a4d5-4d7d-b490-5c02debba69a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:06.408694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a541e80-a4d5-4d7d-b490-5c02debba69a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9a541e80-a4d5-4d7d-b490-5c02debba69a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:06.419055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:06.420176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:15:06.421051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:06.424181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 456/915] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:15:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:06.430433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7f18a-3b3d-4110-8735-0b927b3b531d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:06.456407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:06.562504 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7f18a-3b3d-4110-8735-0b927b3b531d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:06.620253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd126d5-4f0b-4de4-ace7-edaa8dc56a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:06.621238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd126d5-4f0b-4de4-ace7-edaa8dc56a2d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:06.621757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd126d5-4f0b-4de4-ace7-edaa8dc56a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:06.622237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd126d5-4f0b-4de4-ace7-edaa8dc56a2d None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:06.623462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd126d5-4f0b-4de4-ace7-edaa8dc56a2d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:06.624008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd126d5-4f0b-4de4-ace7-edaa8dc56a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:06.626577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd126d5-4f0b-4de4-ace7-edaa8dc56a2d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:06.636523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 460/916] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:15:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:06.645305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541e80-a4d5-4d7d-b490-5c02debba69a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:06.680500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:06.777992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541e80-a4d5-4d7d-b490-5c02debba69a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:06.816518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc068d7-32a5-4ec5-bc32-97969ad93dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:06.817177 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc068d7-32a5-4ec5-bc32-97969ad93dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:06.817518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc068d7-32a5-4ec5-bc32-97969ad93dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:06.817798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc068d7-32a5-4ec5-bc32-97969ad93dd1 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:06.818512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc068d7-32a5-4ec5-bc32-97969ad93dd1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:06.818811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc068d7-32a5-4ec5-bc32-97969ad93dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:06.820208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc068d7-32a5-4ec5-bc32-97969ad93dd1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:06.826509 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 457/917] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 26 07:15:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:06.832069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd126d5-4f0b-4de4-ace7-edaa8dc56a2d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:06.881956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f489-c5f4-4484-8418-cbe6f2e25e38 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:06.882316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f489-c5f4-4484-8418-cbe6f2e25e38 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:06.882695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f489-c5f4-4484-8418-cbe6f2e25e38 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:06.884520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 458/918] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:06.890067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a93ddf-fb55-4123-8908-63c806f77ef6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:06.890424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a93ddf-fb55-4123-8908-63c806f77ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:06.890766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a93ddf-fb55-4123-8908-63c806f77ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:06.909735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-02a93ddf-fb55-4123-8908-63c806f77ef6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:06.911222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-02a93ddf-fb55-4123-8908-63c806f77ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:06.956786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:06.974089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd126d5-4f0b-4de4-ace7-edaa8dc56a2d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:06.993553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 459/919] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:07.010684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a93ddf-fb55-4123-8908-63c806f77ef6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:07.040085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eafbc-b190-4c2f-a9e2-e7afd6e9b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:07.041725 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:07.042957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eafbc-b190-4c2f-a9e2-e7afd6e9b6bc None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.043510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eafbc-b190-4c2f-a9e2-e7afd6e9b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.043981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eafbc-b190-4c2f-a9e2-e7afd6e9b6bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.045545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eafbc-b190-4c2f-a9e2-e7afd6e9b6bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:07.048265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eafbc-b190-4c2f-a9e2-e7afd6e9b6bc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:07.092036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 461/920] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:15:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:07.142386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a93ddf-fb55-4123-8908-63c806f77ef6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:07.192015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4be2e-dece-4df3-a6cd-be263bccaeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:07.192702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4be2e-dece-4df3-a6cd-be263bccaeef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.192976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4be2e-dece-4df3-a6cd-be263bccaeef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.193249 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4be2e-dece-4df3-a6cd-be263bccaeef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.206634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4be2e-dece-4df3-a6cd-be263bccaeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d8e4be2e-dece-4df3-a6cd-be263bccaeef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:07.212417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:07.213502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:07.214398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 460/921] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 26 07:15:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:07.220833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eafbc-b190-4c2f-a9e2-e7afd6e9b6bc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:07.274957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d771bd0-0875-48c2-924a-7a8494b73a3d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.275320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d771bd0-0875-48c2-924a-7a8494b73a3d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.275502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d771bd0-0875-48c2-924a-7a8494b73a3d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.277244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 461/922] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:07.283203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b2f0-e324-4bb0-896c-5d9a91e191ff None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.283445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b2f0-e324-4bb0-896c-5d9a91e191ff None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.283781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b2f0-e324-4bb0-896c-5d9a91e191ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.310591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-85b8b2f0-e324-4bb0-896c-5d9a91e191ff None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:07.312089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-85b8b2f0-e324-4bb0-896c-5d9a91e191ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:07.395437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eafbc-b190-4c2f-a9e2-e7afd6e9b6bc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:07.436957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 462/923] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:07.447628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049e126-bd6b-476a-8902-801053ecd830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:07.448429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049e126-bd6b-476a-8902-801053ecd830 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.448824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049e126-bd6b-476a-8902-801053ecd830 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.449215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049e126-bd6b-476a-8902-801053ecd830 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.450117 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049e126-bd6b-476a-8902-801053ecd830 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:07.450536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049e126-bd6b-476a-8902-801053ecd830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:07.452051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049e126-bd6b-476a-8902-801053ecd830 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:07.463059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8b2f0-e324-4bb0-896c-5d9a91e191ff None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:07.466890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 462/924] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 26 07:15:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:07.481289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049e126-bd6b-476a-8902-801053ecd830 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:07.481651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:07.483240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:07.576068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8b2f0-e324-4bb0-896c-5d9a91e191ff None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:07.615739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23b441-12b1-4702-8f16-d35084e0647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:07.617013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23b441-12b1-4702-8f16-d35084e0647f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.617813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23b441-12b1-4702-8f16-d35084e0647f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.618233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23b441-12b1-4702-8f16-d35084e0647f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.619018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23b441-12b1-4702-8f16-d35084e0647f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:07.620641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23b441-12b1-4702-8f16-d35084e0647f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-de23b441-12b1-4702-8f16-d35084e0647f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:07.630960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:07.632279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:07.633370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:07.635990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 463/925] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:15:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:07.650436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23b441-12b1-4702-8f16-d35084e0647f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:07.677869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049e126-bd6b-476a-8902-801053ecd830 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:07.741396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165a7e-9f58-483a-90a9-a1522423966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:07.742441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165a7e-9f58-483a-90a9-a1522423966a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.742902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165a7e-9f58-483a-90a9-a1522423966a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.743369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165a7e-9f58-483a-90a9-a1522423966a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.769337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165a7e-9f58-483a-90a9-a1522423966a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:07.773200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165a7e-9f58-483a-90a9-a1522423966a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:07.791552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-79165a7e-9f58-483a-90a9-a1522423966a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:07.796789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:07.799015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:07.801239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:07.801239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:07.801239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:07.801239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:07.801239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 463/926] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:07.801239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e941bd-acf1-4a9f-846d-1b6a89c1af89 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.801239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e941bd-acf1-4a9f-846d-1b6a89c1af89 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.801239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e941bd-acf1-4a9f-846d-1b6a89c1af89 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.802577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 464/927] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:07.806325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e941bd-acf1-4a9f-846d-1b6a89c1af89 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:07.833067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23b441-12b1-4702-8f16-d35084e0647f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:07.887363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03971206-f5ee-40dc-be43-666c8580ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:07.888254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03971206-f5ee-40dc-be43-666c8580ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.888670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03971206-f5ee-40dc-be43-666c8580ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.889065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03971206-f5ee-40dc-be43-666c8580ecc3 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.889943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03971206-f5ee-40dc-be43-666c8580ecc3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:07.890369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03971206-f5ee-40dc-be43-666c8580ecc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:07.892107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03971206-f5ee-40dc-be43-666c8580ecc3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:07.905414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 464/928] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:07.905414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293d47-9079-4a10-b168-fe81882bbed6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:07.905414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293d47-9079-4a10-b168-fe81882bbed6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:07.905414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293d47-9079-4a10-b168-fe81882bbed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:07.908277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:07.928923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-38293d47-9079-4a10-b168-fe81882bbed6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:07.930340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38293d47-9079-4a10-b168-fe81882bbed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:07.994892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e941bd-acf1-4a9f-846d-1b6a89c1af89 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:08.016977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 465/929] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:08.018303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293d47-9079-4a10-b168-fe81882bbed6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:08.067809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c79cb0-c99b-44f5-8a81-9c4ca4893194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:08.069613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c79cb0-c99b-44f5-8a81-9c4ca4893194 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:08.070627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c79cb0-c99b-44f5-8a81-9c4ca4893194 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:08.071356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c79cb0-c99b-44f5-8a81-9c4ca4893194 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:08.073612 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c79cb0-c99b-44f5-8a81-9c4ca4893194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:08.074412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c79cb0-c99b-44f5-8a81-9c4ca4893194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:08.077435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c79cb0-c99b-44f5-8a81-9c4ca4893194 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:08.104542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 465/930] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:08.104542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c79cb0-c99b-44f5-8a81-9c4ca4893194 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:08.148087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:08.187691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293d47-9079-4a10-b168-fe81882bbed6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:08.230369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef418e-b586-4b27-b673-d291cca2a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:08.231205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef418e-b586-4b27-b673-d291cca2a31f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:08.231610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef418e-b586-4b27-b673-d291cca2a31f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:08.232008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef418e-b586-4b27-b673-d291cca2a31f None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:08.232873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef418e-b586-4b27-b673-d291cca2a31f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:08.233349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef418e-b586-4b27-b673-d291cca2a31f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:08.235202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef418e-b586-4b27-b673-d291cca2a31f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:08.243790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 466/931] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:08.245085 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef418e-b586-4b27-b673-d291cca2a31f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:08.280485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c79cb0-c99b-44f5-8a81-9c4ca4893194 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:08.297760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:08.321818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68592790-af7e-4eca-a344-a80dc9bd1bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:08.322505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68592790-af7e-4eca-a344-a80dc9bd1bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:08.322779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68592790-af7e-4eca-a344-a80dc9bd1bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:08.323053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68592790-af7e-4eca-a344-a80dc9bd1bc6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:08.323721 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68592790-af7e-4eca-a344-a80dc9bd1bc6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:08.325160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68592790-af7e-4eca-a344-a80dc9bd1bc6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-68592790-af7e-4eca-a344-a80dc9bd1bc6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:08.335128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:08.337058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:08.338722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 466/932] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jul 26 07:15:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:08.340351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68592790-af7e-4eca-a344-a80dc9bd1bc6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:08.445671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef418e-b586-4b27-b673-d291cca2a31f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:08.482342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68592790-af7e-4eca-a344-a80dc9bd1bc6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:08.505193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a554-cfd7-4ea4-af28-511c73f8e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:08.506221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a554-cfd7-4ea4-af28-511c73f8e148 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:08.506665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a554-cfd7-4ea4-af28-511c73f8e148 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:08.507111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a554-cfd7-4ea4-af28-511c73f8e148 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:08.512091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:08.522500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469a554-cfd7-4ea4-af28-511c73f8e148 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:08.525041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469a554-cfd7-4ea4-af28-511c73f8e148 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:08.545742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d1065-5a98-4283-a560-a2b20f130f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:08.546708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d1065-5a98-4283-a560-a2b20f130f6c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:08.547138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d1065-5a98-4283-a560-a2b20f130f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:08.547569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d1065-5a98-4283-a560-a2b20f130f6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3469a554-cfd7-4ea4-af28-511c73f8e148 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:15:08.548562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:08.550553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:15:08.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:08.554672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d1065-5a98-4283-a560-a2b20f130f6c None admin] RBAC: Adding query filter params (interface=public, service_id=6e6f7e245ab24479b711ec9a3d05ea3f, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:08.554672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d1065-5a98-4283-a560-a2b20f130f6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:08.554952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 467/933] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:15:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:08.554952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a554-cfd7-4ea4-af28-511c73f8e148 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:08.558163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d1065-5a98-4283-a560-a2b20f130f6c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:08.567460 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 467/934] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 26 07:15:08 2022] GET /identity/v3/endpoints?service_id=6e6f7e245ab24479b711ec9a3d05ea3f&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:08.569610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d1065-5a98-4283-a560-a2b20f130f6c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:08.639048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:08.711995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a554-cfd7-4ea4-af28-511c73f8e148 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:08.731046 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d1065-5a98-4283-a560-a2b20f130f6c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:08.766656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8593e-f795-4cb5-96df-d90eabd6971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:08.767742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8593e-f795-4cb5-96df-d90eabd6971d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:08.768310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8593e-f795-4cb5-96df-d90eabd6971d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:08.768802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8593e-f795-4cb5-96df-d90eabd6971d None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:08.770134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8593e-f795-4cb5-96df-d90eabd6971d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:08.770682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8593e-f795-4cb5-96df-d90eabd6971d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:08.773359 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8593e-f795-4cb5-96df-d90eabd6971d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:08.782643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 468/935] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:15:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:08.784249 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8593e-f795-4cb5-96df-d90eabd6971d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:08.793623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91d4d4-e13c-4cf0-be62-022ace80f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:08.795073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91d4d4-e13c-4cf0-be62-022ace80f157 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:08.795761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91d4d4-e13c-4cf0-be62-022ace80f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:08.796419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91d4d4-e13c-4cf0-be62-022ace80f157 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:08.798262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91d4d4-e13c-4cf0-be62-022ace80f157 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:08.799092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91d4d4-e13c-4cf0-be62-022ace80f157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:08.802473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91d4d4-e13c-4cf0-be62-022ace80f157 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:08.839354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 468/936] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 26 07:15:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:08.841546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91d4d4-e13c-4cf0-be62-022ace80f157 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:08.894618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:08.963799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8593e-f795-4cb5-96df-d90eabd6971d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:09.017350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70be71b-5278-4e53-813d-2075b46be266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:09.018184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70be71b-5278-4e53-813d-2075b46be266 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:09.018476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70be71b-5278-4e53-813d-2075b46be266 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:09.018734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70be71b-5278-4e53-813d-2075b46be266 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:09.019849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70be71b-5278-4e53-813d-2075b46be266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:09.020922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70be71b-5278-4e53-813d-2075b46be266 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:09.037304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 469/937] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 26 07:15:08 2022] GET /identity/v3/services => generated 1497 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:15:09.037304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70be71b-5278-4e53-813d-2075b46be266 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:09.040648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:09.048885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91d4d4-e13c-4cf0-be62-022ace80f157 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:09.111325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4693dd-31e4-4028-8200-7dbe1d4d23a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:09.112591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4693dd-31e4-4028-8200-7dbe1d4d23a2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:09.113159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4693dd-31e4-4028-8200-7dbe1d4d23a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:09.113731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4693dd-31e4-4028-8200-7dbe1d4d23a2 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:09.115266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4693dd-31e4-4028-8200-7dbe1d4d23a2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:09.115678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4693dd-31e4-4028-8200-7dbe1d4d23a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:09.117947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4693dd-31e4-4028-8200-7dbe1d4d23a2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:09.127566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 469/938] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:15:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:09.135312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4693dd-31e4-4028-8200-7dbe1d4d23a2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:09.235045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70be71b-5278-4e53-813d-2075b46be266 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:09.285819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:09.310341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66829073-40c0-4b55-b3cb-2f212ba3f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:09.312120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66829073-40c0-4b55-b3cb-2f212ba3f9af None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:09.312817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66829073-40c0-4b55-b3cb-2f212ba3f9af None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:09.314705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66829073-40c0-4b55-b3cb-2f212ba3f9af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:09.319290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4693dd-31e4-4028-8200-7dbe1d4d23a2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:09.340902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66829073-40c0-4b55-b3cb-2f212ba3f9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:09.345187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66829073-40c0-4b55-b3cb-2f212ba3f9af None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-66829073-40c0-4b55-b3cb-2f212ba3f9af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:09.364128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:09.366494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:09.368639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:09.368639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:09.368639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:09.368639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:09.368639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 470/939] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:09.372011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66829073-40c0-4b55-b3cb-2f212ba3f9af None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:09.384364 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fda7d-04d7-46b3-9200-817f1607abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:09.385045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fda7d-04d7-46b3-9200-817f1607abf2 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:09.388636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fda7d-04d7-46b3-9200-817f1607abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:09.388636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fda7d-04d7-46b3-9200-817f1607abf2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:09.388636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fda7d-04d7-46b3-9200-817f1607abf2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:09.388636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fda7d-04d7-46b3-9200-817f1607abf2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:09.412529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 470/940] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:15:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:15:09.588116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66829073-40c0-4b55-b3cb-2f212ba3f9af None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:09.673844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb93d1b-389e-43cd-bb3c-44adf2b41013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:09.675274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb93d1b-389e-43cd-bb3c-44adf2b41013 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:09.675818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb93d1b-389e-43cd-bb3c-44adf2b41013 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:09.676311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb93d1b-389e-43cd-bb3c-44adf2b41013 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:09.677957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb93d1b-389e-43cd-bb3c-44adf2b41013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:09.678514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb93d1b-389e-43cd-bb3c-44adf2b41013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:09.681472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb93d1b-389e-43cd-bb3c-44adf2b41013 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:09.708767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 471/941] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:09.716670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fda7d-04d7-46b3-9200-817f1607abf2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:09.747014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:09.840655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e6822-017d-4e08-9f43-7287e3bb22b6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:09.840853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e6822-017d-4e08-9f43-7287e3bb22b6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:09.841102 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e6822-017d-4e08-9f43-7287e3bb22b6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:09.843173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 472/942] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:09.848961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fda7d-04d7-46b3-9200-817f1607abf2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:09.849522 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66f28-479e-4161-993e-165a37a4e246 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:09.849809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66f28-479e-4161-993e-165a37a4e246 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:09.850081 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66f28-479e-4161-993e-165a37a4e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:09.872035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-42c66f28-479e-4161-993e-165a37a4e246 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:09.873290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42c66f28-479e-4161-993e-165a37a4e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:09.901180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5271-52ce-4a70-a7f7-33e62a4f9f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:09.901907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5271-52ce-4a70-a7f7-33e62a4f9f22 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:09.902189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5271-52ce-4a70-a7f7-33e62a4f9f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:09.902465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5271-52ce-4a70-a7f7-33e62a4f9f22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:09.911274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c5271-52ce-4a70-a7f7-33e62a4f9f22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:09.912612 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c5271-52ce-4a70-a7f7-33e62a4f9f22 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:09.914992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f14c5271-52ce-4a70-a7f7-33e62a4f9f22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:15:09.928955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:09.930060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:09.930995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:15:09.930995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:15:09.930995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:15:09.930995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:15:09.930995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:15:09.930995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:15:09.930995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:09.930995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:09.930995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 471/943] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:09.936988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5271-52ce-4a70-a7f7-33e62a4f9f22 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:09.982483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 473/944] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:10.005529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66f28-479e-4161-993e-165a37a4e246 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:10.089521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:10.129482 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5271-52ce-4a70-a7f7-33e62a4f9f22 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:10.168995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66f28-479e-4161-993e-165a37a4e246 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:10.173414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db5857-7e2c-4d51-b31a-1a6bb50c52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:10.174156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db5857-7e2c-4d51-b31a-1a6bb50c52bc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:10.174441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db5857-7e2c-4d51-b31a-1a6bb50c52bc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:10.174717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db5857-7e2c-4d51-b31a-1a6bb50c52bc None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:10.181292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db5857-7e2c-4d51-b31a-1a6bb50c52bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:10.181292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db5857-7e2c-4d51-b31a-1a6bb50c52bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:10.181292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db5857-7e2c-4d51-b31a-1a6bb50c52bc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:10.198720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 472/945] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:10.199757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db5857-7e2c-4d51-b31a-1a6bb50c52bc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:10.245312 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:10.246327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:10.246764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:10.247187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:10.248301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:10.252454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:10.258889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WARNING keystone.server.flask.common [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 07:15:10.302192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.sql.core [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 07:15:10.302192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 07:15:10.302192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [parameters: {'id': '592a59c8bbac4e779bd248777b62b550', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 07:15:10.302192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80192) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 592a59c8bbac4e779bd248777b62b550.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 592a59c8bbac4e779bd248777b62b550. Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:15:10.330341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 07:15:10.331543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application yield resource Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise self.value Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application session.commit() Jul 26 07:15:10.332740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.flush() Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application compat.raise_( Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 07:15:10.333936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 07:15:10.334865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:15:10.335685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [parameters: {'id': '592a59c8bbac4e779bd248777b62b550', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:10.336625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:10.337501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 592a59c8bbac4e779bd248777b62b550. Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:10.349989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 474/946] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Jul 26 07:15:10 2022] POST /identity/v3/projects => generated 262 bytes in 327 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:10.351171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db5857-7e2c-4d51-b31a-1a6bb50c52bc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:10.351310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:10.369141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:10.410808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8e49b-32b1-4e7a-b5fc-ef182cf66bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:10.411432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8e49b-32b1-4e7a-b5fc-ef182cf66bc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:10.411713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8e49b-32b1-4e7a-b5fc-ef182cf66bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:10.412004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8e49b-32b1-4e7a-b5fc-ef182cf66bc1 None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/53d237d0049541999d292b88d851e95a/roles/aff1b21495a74c7fa12170715d44de2d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:10.415363 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8e49b-32b1-4e7a-b5fc-ef182cf66bc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=53d237d0049541999d292b88d851e95a, role_id=aff1b21495a74c7fa12170715d44de2d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:10.417058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8e49b-32b1-4e7a-b5fc-ef182cf66bc1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:10.431133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:10.440812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 473/947] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:15:10 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/53d237d0049541999d292b88d851e95a/roles/aff1b21495a74c7fa12170715d44de2d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:15:10.547742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542888b-cad6-40f7-b01d-f2b54a54d1f1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:10.601302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c05d0-bef8-4f76-9196-b996b9bd409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:10.602142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c05d0-bef8-4f76-9196-b996b9bd409d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:10.602491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c05d0-bef8-4f76-9196-b996b9bd409d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:10.602872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c05d0-bef8-4f76-9196-b996b9bd409d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:10.612544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c05d0-bef8-4f76-9196-b996b9bd409d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:10.614535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c05d0-bef8-4f76-9196-b996b9bd409d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-710c05d0-bef8-4f76-9196-b996b9bd409d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:15:10.629434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:10.631592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:10.633730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:15:10.633730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:15:10.633730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:15:10.633730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:15:10.633730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:15:10.633730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:15:10.633730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:10.633730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:10.633730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 475/948] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:10.639690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8e49b-32b1-4e7a-b5fc-ef182cf66bc1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:10.768591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8e49b-32b1-4e7a-b5fc-ef182cf66bc1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:10.808944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7e010-d222-47ec-91fe-dae56b3c062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:10.809714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7e010-d222-47ec-91fe-dae56b3c062a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:10.809996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7e010-d222-47ec-91fe-dae56b3c062a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:10.810272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7e010-d222-47ec-91fe-dae56b3c062a None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:10.811040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7e010-d222-47ec-91fe-dae56b3c062a None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:10.811348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7e010-d222-47ec-91fe-dae56b3c062a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:10.812937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7e010-d222-47ec-91fe-dae56b3c062a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:10.834570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 474/949] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:15:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:11.859756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a589f8-cfa9-4fff-9c0d-01028a1bac92 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:11.859756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a589f8-cfa9-4fff-9c0d-01028a1bac92 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:11.859756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a589f8-cfa9-4fff-9c0d-01028a1bac92 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:11.859756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 476/950] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:11.870097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a95b2f-7970-4eda-9848-57e7ce938fc2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:11.870097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a95b2f-7970-4eda-9848-57e7ce938fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:11.870097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a95b2f-7970-4eda-9848-57e7ce938fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:11.888690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-05a95b2f-7970-4eda-9848-57e7ce938fc2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:11.890282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-05a95b2f-7970-4eda-9848-57e7ce938fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:11.933555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81023e0-9fed-452c-945a-b50342130c02 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:11.933885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81023e0-9fed-452c-945a-b50342130c02 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:11.934301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81023e0-9fed-452c-945a-b50342130c02 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:11.935885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 477/951] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:11.943710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87a35-8ea6-476d-894c-5a267a5a40f0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:11.944102 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87a35-8ea6-476d-894c-5a267a5a40f0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:11.944255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87a35-8ea6-476d-894c-5a267a5a40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:11.968929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-edc87a35-8ea6-476d-894c-5a267a5a40f0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:11.970636 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-edc87a35-8ea6-476d-894c-5a267a5a40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:11.979308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:12.005816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 475/952] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:12.038060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a95b2f-7970-4eda-9848-57e7ce938fc2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:12.109433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 478/953] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:12.137549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc87a35-8ea6-476d-894c-5a267a5a40f0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:12.149483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:12.185358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a95b2f-7970-4eda-9848-57e7ce938fc2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:12.226014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa943ff0-ea07-4cd9-8c92-c46a828a6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:12.226899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa943ff0-ea07-4cd9-8c92-c46a828a6376 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:12.227225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa943ff0-ea07-4cd9-8c92-c46a828a6376 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:12.227520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa943ff0-ea07-4cd9-8c92-c46a828a6376 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:12.228230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa943ff0-ea07-4cd9-8c92-c46a828a6376 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:12.229798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa943ff0-ea07-4cd9-8c92-c46a828a6376 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-fa943ff0-ea07-4cd9-8c92-c46a828a6376 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:12.240885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:12.243603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:15:12.246751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:12.258288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 476/954] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:12.258288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa943ff0-ea07-4cd9-8c92-c46a828a6376 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:12.259398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc87a35-8ea6-476d-894c-5a267a5a40f0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:12.302172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482f6c-71b4-4600-834f-54a204aa88dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:12.302928 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482f6c-71b4-4600-834f-54a204aa88dd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:12.303215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482f6c-71b4-4600-834f-54a204aa88dd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:12.303492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482f6c-71b4-4600-834f-54a204aa88dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:12.304160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d482f6c-71b4-4600-834f-54a204aa88dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:12.305953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d482f6c-71b4-4600-834f-54a204aa88dd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:12.312123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2d482f6c-71b4-4600-834f-54a204aa88dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:12.319129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:12.322595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:12.324789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 479/955] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:15:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:12.334841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482f6c-71b4-4600-834f-54a204aa88dd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:12.403596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa943ff0-ea07-4cd9-8c92-c46a828a6376 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:12.418011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:12.462207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482f6c-71b4-4600-834f-54a204aa88dd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:12.465502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0893de4-017b-436a-8f51-bcad162b42bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:12.466724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0893de4-017b-436a-8f51-bcad162b42bb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:12.467634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0893de4-017b-436a-8f51-bcad162b42bb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:12.468215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0893de4-017b-436a-8f51-bcad162b42bb None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:12.469582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0893de4-017b-436a-8f51-bcad162b42bb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:12.470297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0893de4-017b-436a-8f51-bcad162b42bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:12.472809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0893de4-017b-436a-8f51-bcad162b42bb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:12.482375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 477/956] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:15:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:12.493295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0893de4-017b-436a-8f51-bcad162b42bb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:12.514116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15693b-618e-436e-a902-34a6041de91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:12.514942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15693b-618e-436e-a902-34a6041de91c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:12.515282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15693b-618e-436e-a902-34a6041de91c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:12.515828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15693b-618e-436e-a902-34a6041de91c None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:12.516881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15693b-618e-436e-a902-34a6041de91c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:12.517286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15693b-618e-436e-a902-34a6041de91c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:12.518824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15693b-618e-436e-a902-34a6041de91c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:12.527048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 480/957] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:12.535010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15693b-618e-436e-a902-34a6041de91c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:12.636024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0893de4-017b-436a-8f51-bcad162b42bb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:12.656093 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:12.676385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0477252-854a-4349-ac2a-009e8ed920cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:12.677017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477252-854a-4349-ac2a-009e8ed920cc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:12.677315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477252-854a-4349-ac2a-009e8ed920cc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:12.677587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477252-854a-4349-ac2a-009e8ed920cc None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:12.678282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0477252-854a-4349-ac2a-009e8ed920cc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:12.678599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0477252-854a-4349-ac2a-009e8ed920cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:12.680273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0477252-854a-4349-ac2a-009e8ed920cc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:12.693295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 478/958] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:15:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:12.693295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c99043-49de-499b-85dd-9ef6781a7936 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:12.693295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c99043-49de-499b-85dd-9ef6781a7936 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:12.693295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c99043-49de-499b-85dd-9ef6781a7936 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:12.693295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 479/959] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:12.697958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad64d85-2b6c-41f9-9b47-df165207a07a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:12.698377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad64d85-2b6c-41f9-9b47-df165207a07a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:12.698849 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad64d85-2b6c-41f9-9b47-df165207a07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:12.722555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bad64d85-2b6c-41f9-9b47-df165207a07a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:12.724613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bad64d85-2b6c-41f9-9b47-df165207a07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:12.734460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15693b-618e-436e-a902-34a6041de91c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:12.793958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975e079-a140-4fe9-b3d6-485ec0882696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:12.794881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975e079-a140-4fe9-b3d6-485ec0882696 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:12.795336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975e079-a140-4fe9-b3d6-485ec0882696 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:12.795764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975e079-a140-4fe9-b3d6-485ec0882696 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:12.796699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975e079-a140-4fe9-b3d6-485ec0882696 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:12.797182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975e079-a140-4fe9-b3d6-485ec0882696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:12.798828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975e079-a140-4fe9-b3d6-485ec0882696 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:12.802538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:12.807964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 481/960] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:12.813748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975e079-a140-4fe9-b3d6-485ec0882696 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:12.830033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 480/961] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:12.855333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad64d85-2b6c-41f9-9b47-df165207a07a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:12.938832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975e079-a140-4fe9-b3d6-485ec0882696 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:12.986511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a35e-fccb-47d1-97a4-c54e3aad92fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:12.987804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a35e-fccb-47d1-97a4-c54e3aad92fb None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:12.988499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a35e-fccb-47d1-97a4-c54e3aad92fb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:12.989199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a35e-fccb-47d1-97a4-c54e3aad92fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:12.990872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57a35e-fccb-47d1-97a4-c54e3aad92fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:12.993539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57a35e-fccb-47d1-97a4-c54e3aad92fb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:13.001693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad64d85-2b6c-41f9-9b47-df165207a07a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:13.018794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:13.029486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 482/962] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:15:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:13.056219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1848a-b01b-4723-8423-cc56015b05dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:13.057129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1848a-b01b-4723-8423-cc56015b05dd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:13.057548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1848a-b01b-4723-8423-cc56015b05dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:13.057928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1848a-b01b-4723-8423-cc56015b05dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:13.072937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1848a-b01b-4723-8423-cc56015b05dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ece1848a-b01b-4723-8423-cc56015b05dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:13.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:13.080465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:13.081573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:13.085477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 481/963] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 26 07:15:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:13.087356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a35e-fccb-47d1-97a4-c54e3aad92fb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:13.174963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:13.241806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a35e-fccb-47d1-97a4-c54e3aad92fb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:13.280495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb61d7-6602-4121-b35e-39f32bc5636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:13.281217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb61d7-6602-4121-b35e-39f32bc5636e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:13.281603 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb61d7-6602-4121-b35e-39f32bc5636e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:13.281879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb61d7-6602-4121-b35e-39f32bc5636e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:13.282879 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eaac9-b6e5-4419-a627-23823f5b8043 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:13.282999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb61d7-6602-4121-b35e-39f32bc5636e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:13.283414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb61d7-6602-4121-b35e-39f32bc5636e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:13.283759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eaac9-b6e5-4419-a627-23823f5b8043 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:13.284249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eaac9-b6e5-4419-a627-23823f5b8043 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:13.285230 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb61d7-6602-4121-b35e-39f32bc5636e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:13.287248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 482/964] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:13.294608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ed44-76ae-4705-859d-450553c6d5c4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:13.294999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ed44-76ae-4705-859d-450553c6d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:13.295289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ed44-76ae-4705-859d-450553c6d5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:13.302217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 483/965] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 26 07:15:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:13.309516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb61d7-6602-4121-b35e-39f32bc5636e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:13.321464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b375ed44-76ae-4705-859d-450553c6d5c4 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:13.323513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b375ed44-76ae-4705-859d-450553c6d5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:13.431307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 483/966] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:13.456743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375ed44-76ae-4705-859d-450553c6d5c4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:13.462267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb61d7-6602-4121-b35e-39f32bc5636e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:13.485232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:13.506626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619db9-aace-4e81-a850-cdb410ca469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:13.507760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619db9-aace-4e81-a850-cdb410ca469c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:13.508261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619db9-aace-4e81-a850-cdb410ca469c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:13.508885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619db9-aace-4e81-a850-cdb410ca469c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:13.523059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619db9-aace-4e81-a850-cdb410ca469c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:13.524924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619db9-aace-4e81-a850-cdb410ca469c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4f619db9-aace-4e81-a850-cdb410ca469c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:13.548212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:13.549878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:13.551004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:13.551004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:13.551004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:13.551004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:13.554150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 484/967] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:13.560036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619db9-aace-4e81-a850-cdb410ca469c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:13.615175 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:13.621681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375ed44-76ae-4705-859d-450553c6d5c4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:13.667719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:13.668377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:13.668709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:13.668981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:13.669743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:13.671220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:13.673877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING keystone.server.flask.common [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 07:15:13.687601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.sql.core [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 07:15:13.687601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 07:15:13.687601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [parameters: {'user_id': '152ca96feec34cfca57002607f55af00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 07:15:13.687601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80191) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 26 07:15:13.700683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:15:13.702475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application yield resource Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise self.value Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application session.commit() Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 07:15:13.704539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.flush() Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application compat.raise_( Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 07:15:13.706009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:15:13.709557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:15:13.712638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [parameters: {'user_id': '152ca96feec34cfca57002607f55af00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:13.717883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 07:15:13.720854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 07:15:13.725983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 07:15:13.725983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 07:15:13.725983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 07:15:13.725983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 07:15:13.725983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 07:15:13.725983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:13.725983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 484/968] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 26 07:15:13 2022] POST /identity/v3/users => generated 160 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:13.725983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:13.763183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619db9-aace-4e81-a850-cdb410ca469c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:13.815541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16a87-dc77-444d-9d9b-a26b7159d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:13.816196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16a87-dc77-444d-9d9b-a26b7159d843 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:13.816474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16a87-dc77-444d-9d9b-a26b7159d843 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:13.816747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16a87-dc77-444d-9d9b-a26b7159d843 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:13.818186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16a87-dc77-444d-9d9b-a26b7159d843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:13.818497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16a87-dc77-444d-9d9b-a26b7159d843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:13.820431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16a87-dc77-444d-9d9b-a26b7159d843 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:13.838912 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 485/969] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:13.849238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16a87-dc77-444d-9d9b-a26b7159d843 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:13.859910 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da145e-5df4-4314-8657-d0d9ee515f51 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:13.898381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:13.917966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de1d92-a355-4995-adf5-f338c5f181a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:13.919092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de1d92-a355-4995-adf5-f338c5f181a2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:13.919633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de1d92-a355-4995-adf5-f338c5f181a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:13.920074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de1d92-a355-4995-adf5-f338c5f181a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:13.934458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de1d92-a355-4995-adf5-f338c5f181a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:13.937127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de1d92-a355-4995-adf5-f338c5f181a2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d5de1d92-a355-4995-adf5-f338c5f181a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:15:13.956792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:13.958541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:13.959813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 485/970] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:15:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:13.964966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de1d92-a355-4995-adf5-f338c5f181a2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:13.993951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:14.014782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16a87-dc77-444d-9d9b-a26b7159d843 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:14.077716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd231e-21be-4152-8edd-bbed0b5171ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:14.078993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd231e-21be-4152-8edd-bbed0b5171ac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:14.079657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd231e-21be-4152-8edd-bbed0b5171ac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:14.080248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd231e-21be-4152-8edd-bbed0b5171ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:14.091598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de1d92-a355-4995-adf5-f338c5f181a2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:14.093766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd231e-21be-4152-8edd-bbed0b5171ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:14.097142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd231e-21be-4152-8edd-bbed0b5171ac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-20cd231e-21be-4152-8edd-bbed0b5171ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:15:14.119055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:14.120703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:15:14.123947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:14.128782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 486/971] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:15:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:14.129204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921b0f3-fa84-47b9-9832-4524f653940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:14.129879 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b0f3-fa84-47b9-9832-4524f653940a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:14.130159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b0f3-fa84-47b9-9832-4524f653940a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:14.130437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b0f3-fa84-47b9-9832-4524f653940a None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:14.131213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921b0f3-fa84-47b9-9832-4524f653940a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:14.131514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921b0f3-fa84-47b9-9832-4524f653940a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:14.132986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921b0f3-fa84-47b9-9832-4524f653940a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:14.145297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd231e-21be-4152-8edd-bbed0b5171ac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:14.185463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 486/972] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 26 07:15:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:14.313930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:14.324593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd231e-21be-4152-8edd-bbed0b5171ac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:14.366937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd359d-e003-4116-a24a-6eed3863c306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:14.367610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd359d-e003-4116-a24a-6eed3863c306 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:14.367894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd359d-e003-4116-a24a-6eed3863c306 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:14.368173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd359d-e003-4116-a24a-6eed3863c306 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:14.369035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd359d-e003-4116-a24a-6eed3863c306 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:14.369381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd359d-e003-4116-a24a-6eed3863c306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:14.370935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd359d-e003-4116-a24a-6eed3863c306 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:14.393888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 487/973] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 26 07:15:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:14.402694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921b0f3-fa84-47b9-9832-4524f653940a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:14.549658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:14.584642 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921b0f3-fa84-47b9-9832-4524f653940a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:14.652773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13003f-00bd-411a-b68a-484609305a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:14.653489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13003f-00bd-411a-b68a-484609305a3b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:14.653789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13003f-00bd-411a-b68a-484609305a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:14.654041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13003f-00bd-411a-b68a-484609305a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:14.748957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13003f-00bd-411a-b68a-484609305a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:14.750631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13003f-00bd-411a-b68a-484609305a3b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:14.843234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:14.872372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 487/974] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:14 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:15:14.880644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd359d-e003-4116-a24a-6eed3863c306 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:15.064294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd359d-e003-4116-a24a-6eed3863c306 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:15.131430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d116769-fc87-4563-b825-4efe4e57f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:15.132367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116769-fc87-4563-b825-4efe4e57f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.132870 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116769-fc87-4563-b825-4efe4e57f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.133297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116769-fc87-4563-b825-4efe4e57f9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.151539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d116769-fc87-4563-b825-4efe4e57f9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:15.153995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d116769-fc87-4563-b825-4efe4e57f9c7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:15.164212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864070-65be-4741-a9e4-f2449c5362e7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.165311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864070-65be-4741-a9e4-f2449c5362e7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.165311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864070-65be-4741-a9e4-f2449c5362e7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.167290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 488/975] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:15.169698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:15.175378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6c645-af36-405f-b210-5ef95d800a9e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.176298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6c645-af36-405f-b210-5ef95d800a9e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.177081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6c645-af36-405f-b210-5ef95d800a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0d116769-fc87-4563-b825-4efe4e57f9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:15.180354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:15.182716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:15.184760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:15.184760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:15.184760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:15.184760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:15.184760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 488/976] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:15.188402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d116769-fc87-4563-b825-4efe4e57f9c7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:15.235028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8ec6c645-af36-405f-b210-5ef95d800a9e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:15.240142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8ec6c645-af36-405f-b210-5ef95d800a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:15.305116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d116769-fc87-4563-b825-4efe4e57f9c7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:15.339637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 489/977] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:15.341035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fc831-c09a-450a-81cd-6e0860fe7211 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.341377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fc831-c09a-450a-81cd-6e0860fe7211 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.341714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fc831-c09a-450a-81cd-6e0860fe7211 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.343716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 490/978] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:15.346363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ddee9-0224-4169-bc64-ec1113be6f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:15.347286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ddee9-0224-4169-bc64-ec1113be6f53 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.348000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ddee9-0224-4169-bc64-ec1113be6f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.348168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ddee9-0224-4169-bc64-ec1113be6f53 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.349110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ddee9-0224-4169-bc64-ec1113be6f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:15.349415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4039a-91fa-4d01-afd7-16b980b46e34 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.349568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4039a-91fa-4d01-afd7-16b980b46e34 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.349732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ddee9-0224-4169-bc64-ec1113be6f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:15.349868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4039a-91fa-4d01-afd7-16b980b46e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.351518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ddee9-0224-4169-bc64-ec1113be6f53 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:15.370181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9bc4039a-91fa-4d01-afd7-16b980b46e34 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:15.370744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 489/979] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:15.371527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ddee9-0224-4169-bc64-ec1113be6f53 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:15.371647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9bc4039a-91fa-4d01-afd7-16b980b46e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:15.441208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:15.475927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 491/980] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:15.477475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4039a-91fa-4d01-afd7-16b980b46e34 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:15.490490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ddee9-0224-4169-bc64-ec1113be6f53 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:15.530896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ef988-9512-41ed-9cc1-76b47c9f1e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:15.531551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ef988-9512-41ed-9cc1-76b47c9f1e26 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.531838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ef988-9512-41ed-9cc1-76b47c9f1e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.532115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ef988-9512-41ed-9cc1-76b47c9f1e26 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.532849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ef988-9512-41ed-9cc1-76b47c9f1e26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:15.534395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ef988-9512-41ed-9cc1-76b47c9f1e26 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:15.538756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:15.556052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 490/981] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:15:15 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:15.557013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ef988-9512-41ed-9cc1-76b47c9f1e26 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:15.644744 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4039a-91fa-4d01-afd7-16b980b46e34 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:15.709947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9ea0d-0823-4b99-bc2f-157ec40183e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:15.711195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9ea0d-0823-4b99-bc2f-157ec40183e5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.711526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9ea0d-0823-4b99-bc2f-157ec40183e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.711869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9ea0d-0823-4b99-bc2f-157ec40183e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.721601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9ea0d-0823-4b99-bc2f-157ec40183e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:15.722788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9ea0d-0823-4b99-bc2f-157ec40183e5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:15.729926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ef988-9512-41ed-9cc1-76b47c9f1e26 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-95d9ea0d-0823-4b99-bc2f-157ec40183e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:15:15.739590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:15.741313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:15.742938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:15:15.742938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:15:15.742938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:15:15.742938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:15:15.742938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:15:15.742938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:15:15.742938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:15.742938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:15.742938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 492/982] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:15.748029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9ea0d-0823-4b99-bc2f-157ec40183e5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:15.765408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:15.788621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1160ee5-e59c-41af-95dd-48c5e0bd6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:15.788931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1160ee5-e59c-41af-95dd-48c5e0bd6a4c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.789251 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1160ee5-e59c-41af-95dd-48c5e0bd6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.789613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1160ee5-e59c-41af-95dd-48c5e0bd6a4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.790565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1160ee5-e59c-41af-95dd-48c5e0bd6a4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:15.791759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1160ee5-e59c-41af-95dd-48c5e0bd6a4c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c1160ee5-e59c-41af-95dd-48c5e0bd6a4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:15.806068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:15.807292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:15.808167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:15.809461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 491/983] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:15:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:15.818127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1160ee5-e59c-41af-95dd-48c5e0bd6a4c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:15.893144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:15.902188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9ea0d-0823-4b99-bc2f-157ec40183e5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:15.951362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5163a-f78c-446a-b535-1bdfce330b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:15.952019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5163a-f78c-446a-b535-1bdfce330b1b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:15.952309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5163a-f78c-446a-b535-1bdfce330b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:15.952574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5163a-f78c-446a-b535-1bdfce330b1b None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:15.953689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5163a-f78c-446a-b535-1bdfce330b1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:15.953864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5163a-f78c-446a-b535-1bdfce330b1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:15.956259 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5163a-f78c-446a-b535-1bdfce330b1b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:15.961907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1160ee5-e59c-41af-95dd-48c5e0bd6a4c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:15.971415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 493/984] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:15:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:15.977880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5163a-f78c-446a-b535-1bdfce330b1b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:16.023249 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a349b-fe53-41b3-aaaf-9f60ff99beaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:16.024266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a349b-fe53-41b3-aaaf-9f60ff99beaa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:16.024719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a349b-fe53-41b3-aaaf-9f60ff99beaa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:16.025154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a349b-fe53-41b3-aaaf-9f60ff99beaa None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:16.026436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a349b-fe53-41b3-aaaf-9f60ff99beaa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:16.026976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a349b-fe53-41b3-aaaf-9f60ff99beaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:16.029515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a349b-fe53-41b3-aaaf-9f60ff99beaa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:16.037697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 492/985] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:16.053475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a349b-fe53-41b3-aaaf-9f60ff99beaa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:16.118019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5163a-f78c-446a-b535-1bdfce330b1b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:16.141706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:16.178842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002526b-4061-416b-b310-866fa5d35f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:16.179582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002526b-4061-416b-b310-866fa5d35f33 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:16.179865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002526b-4061-416b-b310-866fa5d35f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:16.180324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002526b-4061-416b-b310-866fa5d35f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:16.181190 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002526b-4061-416b-b310-866fa5d35f33 None admin] RBAC: Adding query filter params (role.id=aff1b21495a74c7fa12170715d44de2d, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=53d237d0049541999d292b88d851e95a) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:16.181757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002526b-4061-416b-b310-866fa5d35f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:16.183385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002526b-4061-416b-b310-866fa5d35f33 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:16.193923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 494/986] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:15:15 2022] GET /identity/v3/role_assignments?user.id=53d237d0049541999d292b88d851e95a&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=aff1b21495a74c7fa12170715d44de2d => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:16.232404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a349b-fe53-41b3-aaaf-9f60ff99beaa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:16.288190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651aa6bc-63ca-4bbc-95c2-20aa956c60e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:16.288889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651aa6bc-63ca-4bbc-95c2-20aa956c60e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:16.289176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651aa6bc-63ca-4bbc-95c2-20aa956c60e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:16.289521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651aa6bc-63ca-4bbc-95c2-20aa956c60e9 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:16.290325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651aa6bc-63ca-4bbc-95c2-20aa956c60e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:16.290634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651aa6bc-63ca-4bbc-95c2-20aa956c60e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:16.292597 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651aa6bc-63ca-4bbc-95c2-20aa956c60e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:16.299749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 493/987] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:16.308199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002526b-4061-416b-b310-866fa5d35f33 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:16.336919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:16.451599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002526b-4061-416b-b310-866fa5d35f33 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:16.517463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e95da-b699-4d9f-87fe-1da091c95c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:16.518539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e95da-b699-4d9f-87fe-1da091c95c9b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:16.519013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e95da-b699-4d9f-87fe-1da091c95c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:16.519561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e95da-b699-4d9f-87fe-1da091c95c9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:16.521650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e95da-b699-4d9f-87fe-1da091c95c9b None admin] RBAC: Adding query filter params (interface=admin, service_id=6e6f7e245ab24479b711ec9a3d05ea3f, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:16.522382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e95da-b699-4d9f-87fe-1da091c95c9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:16.524911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e95da-b699-4d9f-87fe-1da091c95c9b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:16.536002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 495/988] 10.222.0.20 () {56 vars in 1249 bytes} [Tue Jul 26 07:15:16 2022] GET /identity/v3/endpoints?service_id=6e6f7e245ab24479b711ec9a3d05ea3f&interface=admin®ion_id=RegionOne => generated 193 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:16.545555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651aa6bc-63ca-4bbc-95c2-20aa956c60e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:16.691459 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651aa6bc-63ca-4bbc-95c2-20aa956c60e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:16.714848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:16.744477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1260b-6502-4880-8b00-ef022af49e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:16.745196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1260b-6502-4880-8b00-ef022af49e44 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:16.745490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1260b-6502-4880-8b00-ef022af49e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:16.745863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1260b-6502-4880-8b00-ef022af49e44 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:16.746773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1260b-6502-4880-8b00-ef022af49e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:16.748305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1260b-6502-4880-8b00-ef022af49e44 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:16.768605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 494/989] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 26 07:15:16 2022] GET /identity/v3/services => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:15:17.795092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cacc8e-5654-42e4-80a6-159252e4cdd8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:17.795770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cacc8e-5654-42e4-80a6-159252e4cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:17.795770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cacc8e-5654-42e4-80a6-159252e4cdd8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:17.797195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 496/990] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:17.803032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f179-b5ad-4424-94c0-0e5aee5d9def None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:17.803537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f179-b5ad-4424-94c0-0e5aee5d9def None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:17.803625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f179-b5ad-4424-94c0-0e5aee5d9def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:17.823376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-03a6f179-b5ad-4424-94c0-0e5aee5d9def None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:17.824592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-03a6f179-b5ad-4424-94c0-0e5aee5d9def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:17.924618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 495/991] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:17.962524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cacc8e-5654-42e4-80a6-159252e4cdd8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:18.116921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:18.157032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cacc8e-5654-42e4-80a6-159252e4cdd8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:18.205954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70336b9-d56e-4655-baeb-a7aee65f0db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:18.206930 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70336b9-d56e-4655-baeb-a7aee65f0db7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:18.207356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70336b9-d56e-4655-baeb-a7aee65f0db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:18.207761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70336b9-d56e-4655-baeb-a7aee65f0db7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:18.208771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70336b9-d56e-4655-baeb-a7aee65f0db7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:18.211033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70336b9-d56e-4655-baeb-a7aee65f0db7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a70336b9-d56e-4655-baeb-a7aee65f0db7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:18.227273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:18.228791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:18.230761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 497/992] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:18.237583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f179-b5ad-4424-94c0-0e5aee5d9def None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:18.364926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f179-b5ad-4424-94c0-0e5aee5d9def None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:18.374975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:18.384689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee878f4-7884-4bec-b50c-1ae7d9b35c10 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:18.386188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee878f4-7884-4bec-b50c-1ae7d9b35c10 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:18.386809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee878f4-7884-4bec-b50c-1ae7d9b35c10 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:18.389707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 498/993] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:18.395654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b01827-c397-4987-bf6e-4d98d16dad0f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:18.395982 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b01827-c397-4987-bf6e-4d98d16dad0f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:18.396213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b01827-c397-4987-bf6e-4d98d16dad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:18.416507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b3b01827-c397-4987-bf6e-4d98d16dad0f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:18.417844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b3b01827-c397-4987-bf6e-4d98d16dad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:18.426741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899fef2-2290-4c83-878d-92f8fd9a05ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:18.427493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899fef2-2290-4c83-878d-92f8fd9a05ef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:18.428086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899fef2-2290-4c83-878d-92f8fd9a05ef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:18.428276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899fef2-2290-4c83-878d-92f8fd9a05ef None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:18.428908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899fef2-2290-4c83-878d-92f8fd9a05ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:18.429300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899fef2-2290-4c83-878d-92f8fd9a05ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:18.431453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899fef2-2290-4c83-878d-92f8fd9a05ef None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:18.446941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 496/994] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:15:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:18.448341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899fef2-2290-4c83-878d-92f8fd9a05ef None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:18.519908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 499/995] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:18.550603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b01827-c397-4987-bf6e-4d98d16dad0f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:18.580256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899fef2-2290-4c83-878d-92f8fd9a05ef None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:18.620418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ee94-bb25-4b46-80b0-7a56522b2122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:18.621131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ee94-bb25-4b46-80b0-7a56522b2122 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:18.621487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ee94-bb25-4b46-80b0-7a56522b2122 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:18.621792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ee94-bb25-4b46-80b0-7a56522b2122 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:18.622568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22ee94-bb25-4b46-80b0-7a56522b2122 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:18.622915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22ee94-bb25-4b46-80b0-7a56522b2122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:18.624399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22ee94-bb25-4b46-80b0-7a56522b2122 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:18.630517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 497/996] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:15:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:18.636281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ee94-bb25-4b46-80b0-7a56522b2122 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:18.689724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:18.691645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:18.728692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b01827-c397-4987-bf6e-4d98d16dad0f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:18.790303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ee94-bb25-4b46-80b0-7a56522b2122 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:18.790677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84c37-b24c-4ce8-ad60-d9cf4c2f7506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:18.791703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84c37-b24c-4ce8-ad60-d9cf4c2f7506 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:18.792184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84c37-b24c-4ce8-ad60-d9cf4c2f7506 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:18.792838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84c37-b24c-4ce8-ad60-d9cf4c2f7506 None admin] PATH_INFO: `/v3/services/image` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:18.794334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb84c37-b24c-4ce8-ad60-d9cf4c2f7506 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:18.797719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb84c37-b24c-4ce8-ad60-d9cf4c2f7506 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1bb84c37-b24c-4ce8-ad60-d9cf4c2f7506 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:18.813342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:18.814536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:18.816094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 500/997] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jul 26 07:15:18 2022] GET /identity/v3/services/image => generated 86 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:18.822912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84c37-b24c-4ce8-ad60-d9cf4c2f7506 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:18.849913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea58a9-f672-4ae5-b829-e955997c0e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:18.851242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea58a9-f672-4ae5-b829-e955997c0e3a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:18.851780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea58a9-f672-4ae5-b829-e955997c0e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:18.852387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea58a9-f672-4ae5-b829-e955997c0e3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:18.854002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea58a9-f672-4ae5-b829-e955997c0e3a None admin] RBAC: Adding query filter params (interface=public, service_id=02dfb78302b843bfa1d04381feb28efa, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:18.854346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea58a9-f672-4ae5-b829-e955997c0e3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:18.855764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea58a9-f672-4ae5-b829-e955997c0e3a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:18.863023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 498/998] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 26 07:15:18 2022] GET /identity/v3/endpoints?service_id=02dfb78302b843bfa1d04381feb28efa&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:18.869439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea58a9-f672-4ae5-b829-e955997c0e3a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:18.992509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84c37-b24c-4ce8-ad60-d9cf4c2f7506 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:19.014622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:19.018747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea58a9-f672-4ae5-b829-e955997c0e3a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:19.038882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432cf9-1995-4c2f-93fc-016d857b6c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:19.039875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432cf9-1995-4c2f-93fc-016d857b6c08 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:19.040408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432cf9-1995-4c2f-93fc-016d857b6c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:19.040862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432cf9-1995-4c2f-93fc-016d857b6c08 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:19.041652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432cf9-1995-4c2f-93fc-016d857b6c08 None admin] RBAC: Adding query filter params (name=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:19.041989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432cf9-1995-4c2f-93fc-016d857b6c08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:19.043542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432cf9-1995-4c2f-93fc-016d857b6c08 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:19.054283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 501/999] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:19.054283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bee5a-e7c9-45d2-87e3-9c025876a55c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:19.054283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bee5a-e7c9-45d2-87e3-9c025876a55c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:19.054283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bee5a-e7c9-45d2-87e3-9c025876a55c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:19.054283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 502/1000] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:19.058823 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bee5a-e7c9-45d2-87e3-9c025876a55c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:19.065202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea0d8e-2609-4810-99f4-916f2d6d0873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:19.065611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:19.066038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea0d8e-2609-4810-99f4-916f2d6d0873 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:19.066316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea0d8e-2609-4810-99f4-916f2d6d0873 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:19.066543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea0d8e-2609-4810-99f4-916f2d6d0873 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:19.067470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea0d8e-2609-4810-99f4-916f2d6d0873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:19.069520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea0d8e-2609-4810-99f4-916f2d6d0873 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:19.078148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 499/1001] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 26 07:15:18 2022] GET /identity/v3/services => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:15:19.080119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7722d-04ba-42fa-83fb-958beab19bd2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:19.080663 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7722d-04ba-42fa-83fb-958beab19bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:19.081251 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7722d-04ba-42fa-83fb-958beab19bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:19.112107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5bc7722d-04ba-42fa-83fb-958beab19bd2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:19.114507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5bc7722d-04ba-42fa-83fb-958beab19bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:19.202568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bee5a-e7c9-45d2-87e3-9c025876a55c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:19.241335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 500/1002] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:19.258114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5ef47-1499-455f-b051-ae4876844299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:19.259757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ef47-1499-455f-b051-ae4876844299 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:19.259757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ef47-1499-455f-b051-ae4876844299 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:19.259990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ef47-1499-455f-b051-ae4876844299 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:19.261616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5ef47-1499-455f-b051-ae4876844299 None admin] RBAC: Adding query filter params (type=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:19.262290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5ef47-1499-455f-b051-ae4876844299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:19.264685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5ef47-1499-455f-b051-ae4876844299 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:19.273003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 503/1003] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:19.283833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7722d-04ba-42fa-83fb-958beab19bd2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:19.456199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:19.473148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7722d-04ba-42fa-83fb-958beab19bd2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:19.519261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d780490-9020-4b92-b23b-0de567791a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:19.520263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780490-9020-4b92-b23b-0de567791a2b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:19.520658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780490-9020-4b92-b23b-0de567791a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:19.521097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780490-9020-4b92-b23b-0de567791a2b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:19.521980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d780490-9020-4b92-b23b-0de567791a2b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:19.523582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d780490-9020-4b92-b23b-0de567791a2b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7d780490-9020-4b92-b23b-0de567791a2b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:19.534360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:19.536815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:19.538973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 501/1004] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 26 07:15:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:19.547472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5ef47-1499-455f-b051-ae4876844299 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:19.643397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:19.682902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5ef47-1499-455f-b051-ae4876844299 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:19.731745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36c32e-0c2f-4b2b-b77d-3c7a906cf325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:19.732271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36c32e-0c2f-4b2b-b77d-3c7a906cf325 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:19.732572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36c32e-0c2f-4b2b-b77d-3c7a906cf325 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:19.732866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36c32e-0c2f-4b2b-b77d-3c7a906cf325 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:19.733661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36c32e-0c2f-4b2b-b77d-3c7a906cf325 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:19.733989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36c32e-0c2f-4b2b-b77d-3c7a906cf325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:19.735490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36c32e-0c2f-4b2b-b77d-3c7a906cf325 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:19.746374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 504/1005] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:19.748200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d780490-9020-4b92-b23b-0de567791a2b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:19.865968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d780490-9020-4b92-b23b-0de567791a2b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:19.906921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3d793-c665-4ea7-8226-74ca047df875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:19.907888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3d793-c665-4ea7-8226-74ca047df875 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:19.908346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3d793-c665-4ea7-8226-74ca047df875 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:19.908812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3d793-c665-4ea7-8226-74ca047df875 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:19.909942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3d793-c665-4ea7-8226-74ca047df875 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:19.910413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3d793-c665-4ea7-8226-74ca047df875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:19.912599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3d793-c665-4ea7-8226-74ca047df875 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:19.921313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 502/1006] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 26 07:15:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:19.929691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36c32e-0c2f-4b2b-b77d-3c7a906cf325 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:20.091191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36c32e-0c2f-4b2b-b77d-3c7a906cf325 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:20.140701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:20.148277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80544b-3bcc-40d4-b4e8-d55db0b19ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:20.149321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80544b-3bcc-40d4-b4e8-d55db0b19ec8 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:20.149801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80544b-3bcc-40d4-b4e8-d55db0b19ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:20.150288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80544b-3bcc-40d4-b4e8-d55db0b19ec8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:20.151670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80544b-3bcc-40d4-b4e8-d55db0b19ec8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:20.154342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80544b-3bcc-40d4-b4e8-d55db0b19ec8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:20.189549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 505/1007] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:15:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:21.313301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcae9b-ad75-4a12-96f7-0526f88d87fd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:21.313863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcae9b-ad75-4a12-96f7-0526f88d87fd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:21.313946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcae9b-ad75-4a12-96f7-0526f88d87fd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:21.315904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 503/1008] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:21.322030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e30c22-823a-4ed0-8bab-0bc39c0449b3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:21.322632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e30c22-823a-4ed0-8bab-0bc39c0449b3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:21.322714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e30c22-823a-4ed0-8bab-0bc39c0449b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:21.343733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d4e30c22-823a-4ed0-8bab-0bc39c0449b3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:21.345052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d4e30c22-823a-4ed0-8bab-0bc39c0449b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:21.441685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 506/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:21.463961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcae9b-ad75-4a12-96f7-0526f88d87fd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:21.502415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:21.619008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcae9b-ad75-4a12-96f7-0526f88d87fd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:21.662787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f1ad9-b23b-4e5c-934b-f039eef05779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:21.663495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1ad9-b23b-4e5c-934b-f039eef05779 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:21.663850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1ad9-b23b-4e5c-934b-f039eef05779 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:21.664146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1ad9-b23b-4e5c-934b-f039eef05779 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:21.664827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f1ad9-b23b-4e5c-934b-f039eef05779 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:21.666565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f1ad9-b23b-4e5c-934b-f039eef05779 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5f4f1ad9-b23b-4e5c-934b-f039eef05779 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:21.677601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:21.679397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:15:21.681855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:21.685292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e30c22-823a-4ed0-8bab-0bc39c0449b3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:21.685618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 504/1010] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:21.770075 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d3795-4d42-4656-a58c-6b1c40fb5948 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:21.770964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d3795-4d42-4656-a58c-6b1c40fb5948 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:21.771257 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d3795-4d42-4656-a58c-6b1c40fb5948 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:21.772966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 505/1011] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:21.779094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596a866-82f2-4530-945d-c11c91172d3e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:21.779379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596a866-82f2-4530-945d-c11c91172d3e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:21.779673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596a866-82f2-4530-945d-c11c91172d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:21.806449 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f596a866-82f2-4530-945d-c11c91172d3e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:21.807693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f596a866-82f2-4530-945d-c11c91172d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:21.835598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e30c22-823a-4ed0-8bab-0bc39c0449b3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:21.859378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:21.883741 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8d3aa-dc37-429f-b204-31b8ad1c0c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:21.884292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8d3aa-dc37-429f-b204-31b8ad1c0c4b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:21.884575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8d3aa-dc37-429f-b204-31b8ad1c0c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:21.884849 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8d3aa-dc37-429f-b204-31b8ad1c0c4b None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:21.885593 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8d3aa-dc37-429f-b204-31b8ad1c0c4b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:21.885901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8d3aa-dc37-429f-b204-31b8ad1c0c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:21.887303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8d3aa-dc37-429f-b204-31b8ad1c0c4b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:21.893027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 507/1012] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:15:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:21.898930 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8d3aa-dc37-429f-b204-31b8ad1c0c4b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:21.902298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 506/1013] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:21.926525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596a866-82f2-4530-945d-c11c91172d3e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:21.946298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:22.032164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8d3aa-dc37-429f-b204-31b8ad1c0c4b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:22.069219 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596a866-82f2-4530-945d-c11c91172d3e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:22.081302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ad9f-d0df-45f1-935c-5a666b41e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:22.082024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ad9f-d0df-45f1-935c-5a666b41e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:22.082314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ad9f-d0df-45f1-935c-5a666b41e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:22.082676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ad9f-d0df-45f1-935c-5a666b41e4f6 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:22.083667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781ad9f-d0df-45f1-935c-5a666b41e4f6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:22.084313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781ad9f-d0df-45f1-935c-5a666b41e4f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:22.086403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781ad9f-d0df-45f1-935c-5a666b41e4f6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:22.099049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 508/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 26 07:15:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:22.101663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ad9f-d0df-45f1-935c-5a666b41e4f6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:22.120684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800269f6-2003-4653-952d-64eaf6bfed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:22.121350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800269f6-2003-4653-952d-64eaf6bfed40 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:22.121651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800269f6-2003-4653-952d-64eaf6bfed40 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:22.122076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800269f6-2003-4653-952d-64eaf6bfed40 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:22.122630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800269f6-2003-4653-952d-64eaf6bfed40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:22.124079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800269f6-2003-4653-952d-64eaf6bfed40 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:22.146951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 507/1015] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:15:21 2022] POST /identity/v3/services => generated 242 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:15:22.173487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:22.255101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ad9f-d0df-45f1-935c-5a666b41e4f6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:22.319044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c02b6-674f-414d-844e-46b23c0852e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:22.320366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c02b6-674f-414d-844e-46b23c0852e9 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:22.320366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c02b6-674f-414d-844e-46b23c0852e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:22.320366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c02b6-674f-414d-844e-46b23c0852e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:22.320937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c02b6-674f-414d-844e-46b23c0852e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:22.322430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c02b6-674f-414d-844e-46b23c0852e9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:22.349369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 509/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:15:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:15:22.385293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70874a-f291-4adc-848e-eeae4bcd2c51 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:22.385988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70874a-f291-4adc-848e-eeae4bcd2c51 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:22.385988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70874a-f291-4adc-848e-eeae4bcd2c51 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:22.387632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 508/1017] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:22.393771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c42c-55a0-40bf-b470-2583ed826db8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:22.394085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c42c-55a0-40bf-b470-2583ed826db8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:22.394325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c42c-55a0-40bf-b470-2583ed826db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:22.416408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3088c42c-55a0-40bf-b470-2583ed826db8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:22.417736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3088c42c-55a0-40bf-b470-2583ed826db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:22.517592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 510/1018] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:22.541698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70874a-f291-4adc-848e-eeae4bcd2c51 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:22.645184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:22.687627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70874a-f291-4adc-848e-eeae4bcd2c51 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:22.729845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57738c3a-292b-46e2-ab60-143c9a598c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:22.730530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57738c3a-292b-46e2-ab60-143c9a598c31 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:22.730807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57738c3a-292b-46e2-ab60-143c9a598c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:22.731121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57738c3a-292b-46e2-ab60-143c9a598c31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:22.732527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57738c3a-292b-46e2-ab60-143c9a598c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:22.734049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57738c3a-292b-46e2-ab60-143c9a598c31 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:22.736165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 509/1019] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:22.742465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088c42c-55a0-40bf-b470-2583ed826db8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:22.771517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:22.865038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088c42c-55a0-40bf-b470-2583ed826db8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:22.910453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d579f5-bf6c-4156-8d32-0a1976c42b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:22.911223 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d579f5-bf6c-4156-8d32-0a1976c42b1e None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:22.911594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d579f5-bf6c-4156-8d32-0a1976c42b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:22.911881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d579f5-bf6c-4156-8d32-0a1976c42b1e None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:22.912793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d579f5-bf6c-4156-8d32-0a1976c42b1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:22.914356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d579f5-bf6c-4156-8d32-0a1976c42b1e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:22.954613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 511/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:15:22 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:24.354949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663af65c-9a08-4127-b86d-8bc799b34248 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:24.355812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663af65c-9a08-4127-b86d-8bc799b34248 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:24.355812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663af65c-9a08-4127-b86d-8bc799b34248 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:24.357176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 510/1021] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:24.364921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2cda0-dc28-42e6-af8e-2cae8c1975f9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:24.365700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2cda0-dc28-42e6-af8e-2cae8c1975f9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:24.365700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2cda0-dc28-42e6-af8e-2cae8c1975f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:24.386247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3ec2cda0-dc28-42e6-af8e-2cae8c1975f9 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:24.387465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3ec2cda0-dc28-42e6-af8e-2cae8c1975f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:24.477308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 512/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:24.503920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663af65c-9a08-4127-b86d-8bc799b34248 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:24.562979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaab3c4-0986-4c0e-acca-ef665e550260 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:24.563242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaab3c4-0986-4c0e-acca-ef665e550260 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:24.563552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaab3c4-0986-4c0e-acca-ef665e550260 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:24.565184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 513/1023] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:24.571867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19116d9b-82e0-47e8-8ef4-c41657690aff None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:24.572449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19116d9b-82e0-47e8-8ef4-c41657690aff None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:24.572736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19116d9b-82e0-47e8-8ef4-c41657690aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:24.590644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:24.599434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-19116d9b-82e0-47e8-8ef4-c41657690aff None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:24.601293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-19116d9b-82e0-47e8-8ef4-c41657690aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:24.637133 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663af65c-9a08-4127-b86d-8bc799b34248 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:24.677472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085255-0d9c-4bdd-af00-7296edb907ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:24.678692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085255-0d9c-4bdd-af00-7296edb907ac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:24.679240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085255-0d9c-4bdd-af00-7296edb907ac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:24.679821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085255-0d9c-4bdd-af00-7296edb907ac None admin] PATH_INFO: `/v3/services/image` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:24.680892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96085255-0d9c-4bdd-af00-7296edb907ac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:24.682712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96085255-0d9c-4bdd-af00-7296edb907ac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-96085255-0d9c-4bdd-af00-7296edb907ac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:24.693750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:24.695772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:24.698049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 511/1024] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jul 26 07:15:24 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:24.702999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085255-0d9c-4bdd-af00-7296edb907ac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:24.714353 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:24.719136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 514/1025] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:24.743141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19116d9b-82e0-47e8-8ef4-c41657690aff None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:24.855226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085255-0d9c-4bdd-af00-7296edb907ac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:24.863547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19116d9b-82e0-47e8-8ef4-c41657690aff None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:24.903010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3181f-934f-48f9-8b82-d60e54859580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:24.903010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3181f-934f-48f9-8b82-d60e54859580 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:24.903010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3181f-934f-48f9-8b82-d60e54859580 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:24.903010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3181f-934f-48f9-8b82-d60e54859580 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:24.904964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3181f-934f-48f9-8b82-d60e54859580 None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:24.904964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3181f-934f-48f9-8b82-d60e54859580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:24.904964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3181f-934f-48f9-8b82-d60e54859580 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:24.913320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 512/1026] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:24.919151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3181f-934f-48f9-8b82-d60e54859580 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:24.919846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e6a4c-dec1-4079-8c31-b5c411ab2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:24.920523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e6a4c-dec1-4079-8c31-b5c411ab2a48 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:24.920795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e6a4c-dec1-4079-8c31-b5c411ab2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:24.921064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e6a4c-dec1-4079-8c31-b5c411ab2a48 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:24.924678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:24.934941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e6a4c-dec1-4079-8c31-b5c411ab2a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1b7e6a4c-dec1-4079-8c31-b5c411ab2a48 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:24.940524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:24.942102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:24.944051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 515/1027] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 26 07:15:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:24.948922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e6a4c-dec1-4079-8c31-b5c411ab2a48 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:25.024551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:25.063687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3181f-934f-48f9-8b82-d60e54859580 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:25.103760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e6a4c-dec1-4079-8c31-b5c411ab2a48 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:25.111657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8ae7b-a091-4849-b6c4-c2e3e39bd128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:25.112300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8ae7b-a091-4849-b6c4-c2e3e39bd128 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.112574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8ae7b-a091-4849-b6c4-c2e3e39bd128 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.112844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8ae7b-a091-4849-b6c4-c2e3e39bd128 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.114103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8ae7b-a091-4849-b6c4-c2e3e39bd128 None admin] RBAC: Adding query filter params (type=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:25.114403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8ae7b-a091-4849-b6c4-c2e3e39bd128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:25.116175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8ae7b-a091-4849-b6c4-c2e3e39bd128 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:25.129853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 513/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:25.131855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8ae7b-a091-4849-b6c4-c2e3e39bd128 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:25.170019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c8a08-bf29-4f5f-9f0c-cdf7bc1b21ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:25.171123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8a08-bf29-4f5f-9f0c-cdf7bc1b21ed None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.171479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8a08-bf29-4f5f-9f0c-cdf7bc1b21ed None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.172017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8a08-bf29-4f5f-9f0c-cdf7bc1b21ed None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.173423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c8a08-bf29-4f5f-9f0c-cdf7bc1b21ed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:25.173994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c8a08-bf29-4f5f-9f0c-cdf7bc1b21ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:25.176789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c8a08-bf29-4f5f-9f0c-cdf7bc1b21ed None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:25.200105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 516/1029] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 26 07:15:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:25.201417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c8a08-bf29-4f5f-9f0c-cdf7bc1b21ed None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:25.257501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8ae7b-a091-4849-b6c4-c2e3e39bd128 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:25.267270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:25.295231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d673e6-a7c9-4bdd-b16b-b07b33dd4f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:25.295874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d673e6-a7c9-4bdd-b16b-b07b33dd4f3a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.296157 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d673e6-a7c9-4bdd-b16b-b07b33dd4f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.296431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d673e6-a7c9-4bdd-b16b-b07b33dd4f3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.297209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d673e6-a7c9-4bdd-b16b-b07b33dd4f3a None admin] RBAC: Adding query filter params (interface=public, service_id=edcb0bb5337d4644b5fe67165df9ca36, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:25.297548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d673e6-a7c9-4bdd-b16b-b07b33dd4f3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:25.299034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d673e6-a7c9-4bdd-b16b-b07b33dd4f3a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:25.301322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:25.309436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 514/1030] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 26 07:15:25 2022] GET /identity/v3/endpoints?service_id=edcb0bb5337d4644b5fe67165df9ca36&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:25.311585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318959d7-5ab5-4adc-8782-a707319876c0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.311853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318959d7-5ab5-4adc-8782-a707319876c0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.312123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318959d7-5ab5-4adc-8782-a707319876c0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.313470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 515/1031] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:25.314159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318959d7-5ab5-4adc-8782-a707319876c0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:25.322233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c8a08-bf29-4f5f-9f0c-cdf7bc1b21ed None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:25.371081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463d45d-7032-4627-bafb-b34e2fd93be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:25.371759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463d45d-7032-4627-bafb-b34e2fd93be2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.372304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463d45d-7032-4627-bafb-b34e2fd93be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.372304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463d45d-7032-4627-bafb-b34e2fd93be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.384025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463d45d-7032-4627-bafb-b34e2fd93be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:25.385541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463d45d-7032-4627-bafb-b34e2fd93be2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d463d45d-7032-4627-bafb-b34e2fd93be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:25.401132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:25.402198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:25.403212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:25.403212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:25.403212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:25.403212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:25.403212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 517/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:25.403727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ea8ca-c76a-4ecc-a0c1-918734cf0c4d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.403858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ea8ca-c76a-4ecc-a0c1-918734cf0c4d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.404122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ea8ca-c76a-4ecc-a0c1-918734cf0c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.424083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ec0ea8ca-c76a-4ecc-a0c1-918734cf0c4d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:25.425212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ec0ea8ca-c76a-4ecc-a0c1-918734cf0c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:25.455910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318959d7-5ab5-4adc-8782-a707319876c0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:25.497710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e8084-d646-4598-854a-75a87656ff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:25.498391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e8084-d646-4598-854a-75a87656ff7b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.498700 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e8084-d646-4598-854a-75a87656ff7b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.499017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e8084-d646-4598-854a-75a87656ff7b None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.499772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e8084-d646-4598-854a-75a87656ff7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:25.501252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e8084-d646-4598-854a-75a87656ff7b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:25.513350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 518/1033] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:25.513350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ea8ca-c76a-4ecc-a0c1-918734cf0c4d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:25.513762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 516/1034] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 26 07:15:25 2022] GET /identity/v3/services => generated 1957 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:15:25.543107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e8084-d646-4598-854a-75a87656ff7b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:25.563554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:25.651761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:25.654686 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ea8ca-c76a-4ecc-a0c1-918734cf0c4d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:25.709822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d053850-3399-4385-91ee-da63ae0f80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:25.710484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d053850-3399-4385-91ee-da63ae0f80f4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.710762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d053850-3399-4385-91ee-da63ae0f80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.711038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d053850-3399-4385-91ee-da63ae0f80f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.711761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d053850-3399-4385-91ee-da63ae0f80f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:25.712068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d053850-3399-4385-91ee-da63ae0f80f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:25.713531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d053850-3399-4385-91ee-da63ae0f80f4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:25.727956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 519/1035] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:25.730577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e8084-d646-4598-854a-75a87656ff7b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:25.734520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d053850-3399-4385-91ee-da63ae0f80f4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:25.792381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ae6a-07c5-4c7f-b9c9-87a7ba488989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:25.793423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ae6a-07c5-4c7f-b9c9-87a7ba488989 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.793704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ae6a-07c5-4c7f-b9c9-87a7ba488989 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.793979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ae6a-07c5-4c7f-b9c9-87a7ba488989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.795304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6ae6a-07c5-4c7f-b9c9-87a7ba488989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:25.796930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6ae6a-07c5-4c7f-b9c9-87a7ba488989 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:25.798666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 517/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:25.804751 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ae6a-07c5-4c7f-b9c9-87a7ba488989 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:25.891774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:25.897452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d053850-3399-4385-91ee-da63ae0f80f4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:25.943996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ae6a-07c5-4c7f-b9c9-87a7ba488989 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:25.961200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00de9eb-1276-463d-8081-083e35b53f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:25.971243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00de9eb-1276-463d-8081-083e35b53f47 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:25.971243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00de9eb-1276-463d-8081-083e35b53f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:25.971243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00de9eb-1276-463d-8081-083e35b53f47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:25.982298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00de9eb-1276-463d-8081-083e35b53f47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:25.984190 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00de9eb-1276-463d-8081-083e35b53f47 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:25.989661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:25.999741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02b731-81cb-4a6d-b018-0c50d22bf11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:26.000408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02b731-81cb-4a6d-b018-0c50d22bf11a None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:26.000650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02b731-81cb-4a6d-b018-0c50d22bf11a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:26.000949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02b731-81cb-4a6d-b018-0c50d22bf11a None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f00de9eb-1276-463d-8081-083e35b53f47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:15:26.001056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:26.002208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:15:26.003422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:26.004054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02b731-81cb-4a6d-b018-0c50d22bf11a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:26.004137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 520/1037] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 26 07:15:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:26.010918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02b731-81cb-4a6d-b018-0c50d22bf11a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:26.012916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00de9eb-1276-463d-8081-083e35b53f47 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:26.040483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 518/1038] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:15:25 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:15:26.154753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00de9eb-1276-463d-8081-083e35b53f47 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:26.202508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5850799-d66e-4ae2-a03a-cc164f00f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:26.203274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5850799-d66e-4ae2-a03a-cc164f00f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:26.203560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5850799-d66e-4ae2-a03a-cc164f00f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:26.203968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5850799-d66e-4ae2-a03a-cc164f00f3f1 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:26.204933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5850799-d66e-4ae2-a03a-cc164f00f3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:26.205391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5850799-d66e-4ae2-a03a-cc164f00f3f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:26.207034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5850799-d66e-4ae2-a03a-cc164f00f3f1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:26.230728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 521/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 26 07:15:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:26.236636 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02b731-81cb-4a6d-b018-0c50d22bf11a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:26.368732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02b731-81cb-4a6d-b018-0c50d22bf11a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:26.410514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b8de6-c707-4266-92a9-16e143855c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:26.411155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8de6-c707-4266-92a9-16e143855c6f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:26.411437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8de6-c707-4266-92a9-16e143855c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:26.411710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8de6-c707-4266-92a9-16e143855c6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:26.481659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:26.500811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b8de6-c707-4266-92a9-16e143855c6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:26.502471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b8de6-c707-4266-92a9-16e143855c6f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:26.616659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 519/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:15:26.622406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5850799-d66e-4ae2-a03a-cc164f00f3f1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:26.656308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:26.781059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5850799-d66e-4ae2-a03a-cc164f00f3f1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:26.820159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017aaab-209e-4089-ad3f-cbe0f777a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:26.820847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017aaab-209e-4089-ad3f-cbe0f777a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:26.821244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017aaab-209e-4089-ad3f-cbe0f777a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:26.821547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017aaab-209e-4089-ad3f-cbe0f777a6e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:26.834864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017aaab-209e-4089-ad3f-cbe0f777a6e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:26.836339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017aaab-209e-4089-ad3f-cbe0f777a6e8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6017aaab-209e-4089-ad3f-cbe0f777a6e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:26.852677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:26.853799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:26.854807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:26.854807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:26.854807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:26.854807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:26.857807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 522/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:26.862500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b8de6-c707-4266-92a9-16e143855c6f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:26.966697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:26.986340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b8de6-c707-4266-92a9-16e143855c6f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:27.026776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41ebdb-2c9a-403c-a489-64f5bba6deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:27.027419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41ebdb-2c9a-403c-a489-64f5bba6deee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:27.027703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41ebdb-2c9a-403c-a489-64f5bba6deee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:27.027980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41ebdb-2c9a-403c-a489-64f5bba6deee None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:27.028682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41ebdb-2c9a-403c-a489-64f5bba6deee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:27.028987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41ebdb-2c9a-403c-a489-64f5bba6deee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:27.030396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41ebdb-2c9a-403c-a489-64f5bba6deee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:27.044010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 520/1042] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:27.052961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017aaab-209e-4089-ad3f-cbe0f777a6e8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:27.132942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:27.196153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017aaab-209e-4089-ad3f-cbe0f777a6e8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:27.234809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435970ba-0325-42d2-a9c6-51700337d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:27.235632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435970ba-0325-42d2-a9c6-51700337d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:27.236033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435970ba-0325-42d2-a9c6-51700337d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:27.236588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435970ba-0325-42d2-a9c6-51700337d7f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:27.244558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435970ba-0325-42d2-a9c6-51700337d7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:27.246047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435970ba-0325-42d2-a9c6-51700337d7f6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-435970ba-0325-42d2-a9c6-51700337d7f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:15:27.259062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:27.260276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:27.261878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:15:27.261878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:15:27.261878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:15:27.261878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:15:27.261878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:15:27.261878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:15:27.261878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:27.261878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:27.261878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 523/1043] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:27.269601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41ebdb-2c9a-403c-a489-64f5bba6deee None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:27.410154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41ebdb-2c9a-403c-a489-64f5bba6deee None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:27.468887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef0092-d876-4fd7-9d9c-f737493c5476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:27.469635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0092-d876-4fd7-9d9c-f737493c5476 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:27.470008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0092-d876-4fd7-9d9c-f737493c5476 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:27.470479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0092-d876-4fd7-9d9c-f737493c5476 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:27.471865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef0092-d876-4fd7-9d9c-f737493c5476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:27.472371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef0092-d876-4fd7-9d9c-f737493c5476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:27.474570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef0092-d876-4fd7-9d9c-f737493c5476 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:27.503900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 521/1044] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:27.506314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435970ba-0325-42d2-a9c6-51700337d7f6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:27.612084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b35c8-37f7-441a-a5e8-5d6189d1ae5d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:27.612468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b35c8-37f7-441a-a5e8-5d6189d1ae5d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:27.612670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b35c8-37f7-441a-a5e8-5d6189d1ae5d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:27.614101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 522/1045] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:27.619605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102f9d5-a7df-4956-99a8-e9b6e959ccc0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:27.619904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102f9d5-a7df-4956-99a8-e9b6e959ccc0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:27.620166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102f9d5-a7df-4956-99a8-e9b6e959ccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:27.637750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:27.647252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d102f9d5-a7df-4956-99a8-e9b6e959ccc0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:27.649054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d102f9d5-a7df-4956-99a8-e9b6e959ccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:27.652809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435970ba-0325-42d2-a9c6-51700337d7f6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:27.685044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:27.693788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfe88d-06bd-4fea-8d01-4ad9321cc6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:27.693788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe88d-06bd-4fea-8d01-4ad9321cc6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:27.694154 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe88d-06bd-4fea-8d01-4ad9321cc6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:27.694295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe88d-06bd-4fea-8d01-4ad9321cc6b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:27.695113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfe88d-06bd-4fea-8d01-4ad9321cc6b1 None admin] RBAC: Adding query filter params (role.id=aff1b21495a74c7fa12170715d44de2d, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=c70a0ca34a3940d1b067430c9c2dc64e) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:27.695427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfe88d-06bd-4fea-8d01-4ad9321cc6b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:27.696895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfe88d-06bd-4fea-8d01-4ad9321cc6b1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:27.713295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 524/1046] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:15:27 2022] GET /identity/v3/role_assignments?user.id=c70a0ca34a3940d1b067430c9c2dc64e&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=aff1b21495a74c7fa12170715d44de2d => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:27.738346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 523/1047] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:27.762505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfe88d-06bd-4fea-8d01-4ad9321cc6b1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:27.952564 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfe88d-06bd-4fea-8d01-4ad9321cc6b1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:28.014124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308c107-5de4-4feb-b639-77270a31e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:28.015213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308c107-5de4-4feb-b639-77270a31e492 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:28.015698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308c107-5de4-4feb-b639-77270a31e492 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:28.016170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308c107-5de4-4feb-b639-77270a31e492 None admin] PATH_INFO: `/v3/services/image` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:28.017326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308c107-5de4-4feb-b639-77270a31e492 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:28.019904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308c107-5de4-4feb-b639-77270a31e492 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2308c107-5de4-4feb-b639-77270a31e492 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:28.035097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:28.036562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:28.042148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 525/1048] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jul 26 07:15:27 2022] GET /identity/v3/services/image => generated 86 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:28.045841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102f9d5-a7df-4956-99a8-e9b6e959ccc0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:28.213165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102f9d5-a7df-4956-99a8-e9b6e959ccc0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:28.274947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771086dd-ae8b-481b-9691-9dd57cdccf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:28.275907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771086dd-ae8b-481b-9691-9dd57cdccf3e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:28.276380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771086dd-ae8b-481b-9691-9dd57cdccf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:28.276816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771086dd-ae8b-481b-9691-9dd57cdccf3e None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:28.279960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771086dd-ae8b-481b-9691-9dd57cdccf3e None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:28.279960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771086dd-ae8b-481b-9691-9dd57cdccf3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:28.283238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771086dd-ae8b-481b-9691-9dd57cdccf3e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:28.286799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:28.295272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 524/1049] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:28.301705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308c107-5de4-4feb-b639-77270a31e492 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:28.378597 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0dec6-5617-49fe-a1d3-74f985d6a755 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:28.378940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0dec6-5617-49fe-a1d3-74f985d6a755 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:28.379196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0dec6-5617-49fe-a1d3-74f985d6a755 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:28.383932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 525/1050] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:28.389374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ab5c7-e1ae-457a-83f6-42415785f7df None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:28.389679 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ab5c7-e1ae-457a-83f6-42415785f7df None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:28.389933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ab5c7-e1ae-457a-83f6-42415785f7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:28.394607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:28.411248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-858ab5c7-e1ae-457a-83f6-42415785f7df None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:28.412519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-858ab5c7-e1ae-457a-83f6-42415785f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:28.470082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308c107-5de4-4feb-b639-77270a31e492 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:28.505182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 526/1051] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:28.524086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0438b5-32d8-4b1f-bdb0-77167bde6006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:28.525151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0438b5-32d8-4b1f-bdb0-77167bde6006 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:28.525689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0438b5-32d8-4b1f-bdb0-77167bde6006 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:28.526181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0438b5-32d8-4b1f-bdb0-77167bde6006 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:28.527396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0438b5-32d8-4b1f-bdb0-77167bde6006 None admin] RBAC: Adding query filter params (type=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:28.528187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0438b5-32d8-4b1f-bdb0-77167bde6006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:28.529388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ab5c7-e1ae-457a-83f6-42415785f7df None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:28.530642 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0438b5-32d8-4b1f-bdb0-77167bde6006 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:28.543291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 526/1052] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:28.545614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0438b5-32d8-4b1f-bdb0-77167bde6006 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:28.666755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ab5c7-e1ae-457a-83f6-42415785f7df None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:28.687418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0438b5-32d8-4b1f-bdb0-77167bde6006 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:28.706438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:28.712869 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162516b9-53de-44da-a119-6cff783c6d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:28.713565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162516b9-53de-44da-a119-6cff783c6d2a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:28.713841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162516b9-53de-44da-a119-6cff783c6d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:28.714102 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162516b9-53de-44da-a119-6cff783c6d2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:28.718797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:28.727098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162516b9-53de-44da-a119-6cff783c6d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-162516b9-53de-44da-a119-6cff783c6d2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:28.732067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:28.734237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:28.735302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 527/1053] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:15:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:28.740998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162516b9-53de-44da-a119-6cff783c6d2a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:28.745143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204b2f4-1c27-4fa7-8384-1d131f1618ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:28.746287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204b2f4-1c27-4fa7-8384-1d131f1618ce None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:28.746730 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204b2f4-1c27-4fa7-8384-1d131f1618ce None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:28.747182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204b2f4-1c27-4fa7-8384-1d131f1618ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:28.749411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204b2f4-1c27-4fa7-8384-1d131f1618ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:28.751751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204b2f4-1c27-4fa7-8384-1d131f1618ce None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:28.786204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 527/1054] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:15:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:28.912471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162516b9-53de-44da-a119-6cff783c6d2a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:28.968404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd41164-b8a5-4c45-b609-e62d0bee5d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:28.969035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd41164-b8a5-4c45-b609-e62d0bee5d17 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:28.969417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd41164-b8a5-4c45-b609-e62d0bee5d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:28.969760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd41164-b8a5-4c45-b609-e62d0bee5d17 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:28.970496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd41164-b8a5-4c45-b609-e62d0bee5d17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:28.970799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd41164-b8a5-4c45-b609-e62d0bee5d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:28.972183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd41164-b8a5-4c45-b609-e62d0bee5d17 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:28.981956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 528/1055] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:15:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:28.989161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204b2f4-1c27-4fa7-8384-1d131f1618ce None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:29.132257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204b2f4-1c27-4fa7-8384-1d131f1618ce None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:29.178026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abfb2-e6f0-4755-a3f8-51863ff1ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:29.178765 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abfb2-e6f0-4755-a3f8-51863ff1ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:29.179046 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abfb2-e6f0-4755-a3f8-51863ff1ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:29.179337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abfb2-e6f0-4755-a3f8-51863ff1ccb7 None admin] PATH_INFO: `/v3/users/b4151191052d419eb1aed8440ca53823` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:29.196770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764abfb2-e6f0-4755-a3f8-51863ff1ccb7 None admin] RBAC: Authorizing `identity:get_user(user_id=b4151191052d419eb1aed8440ca53823)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:29.198604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764abfb2-e6f0-4755-a3f8-51863ff1ccb7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:29.200566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 528/1056] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:28 2022] GET /identity/v3/users/b4151191052d419eb1aed8440ca53823 => generated 285 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:29.208117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd41164-b8a5-4c45-b609-e62d0bee5d17 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:29.276126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:29.343702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd41164-b8a5-4c45-b609-e62d0bee5d17 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:29.407834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139adb45-ea98-4a81-9b15-6df0f1f8f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:29.409171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139adb45-ea98-4a81-9b15-6df0f1f8f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:29.409644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139adb45-ea98-4a81-9b15-6df0f1f8f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:29.410068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139adb45-ea98-4a81-9b15-6df0f1f8f4a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:29.521625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139adb45-ea98-4a81-9b15-6df0f1f8f4a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:29.523950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139adb45-ea98-4a81-9b15-6df0f1f8f4a7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:29.581889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:29.654717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 529/1057] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:15:29.656002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abfb2-e6f0-4755-a3f8-51863ff1ccb7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:29.705160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:29.783862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abfb2-e6f0-4755-a3f8-51863ff1ccb7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:29.824846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf09195-e215-47d0-aeff-004860de911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:29.825829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf09195-e215-47d0-aeff-004860de911a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:29.826283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf09195-e215-47d0-aeff-004860de911a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:29.826692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf09195-e215-47d0-aeff-004860de911a None admin] PATH_INFO: `/v3/projects/7c2e0852cb824ef891e18cf68316b4ea` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:29.828253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf09195-e215-47d0-aeff-004860de911a None admin] RBAC: Authorizing `identity:get_project(project_id=7c2e0852cb824ef891e18cf68316b4ea)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:29.830181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf09195-e215-47d0-aeff-004860de911a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:29.832584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 529/1058] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:15:29 2022] GET /identity/v3/projects/7c2e0852cb824ef891e18cf68316b4ea => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:29.842816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139adb45-ea98-4a81-9b15-6df0f1f8f4a7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:29.892461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506a6fe-654e-4e09-bc13-62b90065e8fb None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:29.892961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506a6fe-654e-4e09-bc13-62b90065e8fb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:29.893467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506a6fe-654e-4e09-bc13-62b90065e8fb None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:29.895786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 530/1059] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:29.903255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcecbc-eac3-4f7b-b7cb-f976cb7f67c6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:29.903570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcecbc-eac3-4f7b-b7cb-f976cb7f67c6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:29.903847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcecbc-eac3-4f7b-b7cb-f976cb7f67c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:29.936663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7ebcecbc-eac3-4f7b-b7cb-f976cb7f67c6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:29.938978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7ebcecbc-eac3-4f7b-b7cb-f976cb7f67c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:29.971811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139adb45-ea98-4a81-9b15-6df0f1f8f4a7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:30.019778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8631ec-1e07-4505-95f1-9e55dc9eb673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:30.020653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8631ec-1e07-4505-95f1-9e55dc9eb673 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:30.020932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8631ec-1e07-4505-95f1-9e55dc9eb673 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:30.021210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8631ec-1e07-4505-95f1-9e55dc9eb673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:30.022479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8631ec-1e07-4505-95f1-9e55dc9eb673 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=7c2e0852cb824ef891e18cf68316b4ea, user.id=b4151191052d419eb1aed8440ca53823) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:30.023014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8631ec-1e07-4505-95f1-9e55dc9eb673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:30.025613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8631ec-1e07-4505-95f1-9e55dc9eb673 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:30.032843 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 530/1060] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:15:29 2022] GET /identity/v3/role_assignments?user.id=b4151191052d419eb1aed8440ca53823&scope.project.id=7c2e0852cb824ef891e18cf68316b4ea&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:30.049315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 531/1061] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:30.082399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8631ec-1e07-4505-95f1-9e55dc9eb673 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:30.106445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:30.237773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8631ec-1e07-4505-95f1-9e55dc9eb673 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:30.295190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6da498-a090-4201-99b4-6bd4d9fce2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:30.295863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6da498-a090-4201-99b4-6bd4d9fce2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:30.296157 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6da498-a090-4201-99b4-6bd4d9fce2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:30.296432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6da498-a090-4201-99b4-6bd4d9fce2d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:30.309699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6da498-a090-4201-99b4-6bd4d9fce2d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ea6da498-a090-4201-99b4-6bd4d9fce2d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:30.315754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:30.317096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:30.319362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 531/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 26 07:15:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:30.325751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcecbc-eac3-4f7b-b7cb-f976cb7f67c6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:30.366232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:30.466092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcecbc-eac3-4f7b-b7cb-f976cb7f67c6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:30.524632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a6984-6641-4153-a66c-55d52d64eb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:30.525285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a6984-6641-4153-a66c-55d52d64eb94 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:30.525594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a6984-6641-4153-a66c-55d52d64eb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:30.525860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a6984-6641-4153-a66c-55d52d64eb94 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:30.526653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a6984-6641-4153-a66c-55d52d64eb94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:30.526954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a6984-6641-4153-a66c-55d52d64eb94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:30.528381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a6984-6641-4153-a66c-55d52d64eb94 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:30.539114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 532/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 26 07:15:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:30.545194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6da498-a090-4201-99b4-6bd4d9fce2d4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:30.638316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:30.675061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6da498-a090-4201-99b4-6bd4d9fce2d4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:30.721785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed36590-d87f-4ab4-ae14-26803a91d79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:30.722561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36590-d87f-4ab4-ae14-26803a91d79e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:30.722836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36590-d87f-4ab4-ae14-26803a91d79e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:30.723171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36590-d87f-4ab4-ae14-26803a91d79e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:30.741125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed36590-d87f-4ab4-ae14-26803a91d79e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:30.743803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed36590-d87f-4ab4-ae14-26803a91d79e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-aed36590-d87f-4ab4-ae14-26803a91d79e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:30.768795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:30.777978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:30.779887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:30.779887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:30.779887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:30.779887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:30.779887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 532/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:30.783483 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a6984-6641-4153-a66c-55d52d64eb94 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:30.882289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e118e-6de4-4de9-a10a-2eaeea7763d2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:30.882570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e118e-6de4-4de9-a10a-2eaeea7763d2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:30.882841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e118e-6de4-4de9-a10a-2eaeea7763d2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:30.884386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 533/1065] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:30.890891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29615a1a-e8ba-4d15-89cd-106ed506a56f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:30.891090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29615a1a-e8ba-4d15-89cd-106ed506a56f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:30.891398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29615a1a-e8ba-4d15-89cd-106ed506a56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:30.901922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:30.910492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a6984-6641-4153-a66c-55d52d64eb94 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:30.912931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-29615a1a-e8ba-4d15-89cd-106ed506a56f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:30.914335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-29615a1a-e8ba-4d15-89cd-106ed506a56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:30.948722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bb9b9-99a5-45a6-9068-035c4e574fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:30.949398 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb9b9-99a5-45a6-9068-035c4e574fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:30.949681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb9b9-99a5-45a6-9068-035c4e574fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:30.949959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb9b9-99a5-45a6-9068-035c4e574fb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:30.950668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bb9b9-99a5-45a6-9068-035c4e574fb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:30.950974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bb9b9-99a5-45a6-9068-035c4e574fb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:30.952374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bb9b9-99a5-45a6-9068-035c4e574fb9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:30.966470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 533/1066] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:30.974808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bb9b9-99a5-45a6-9068-035c4e574fb9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:31.004198 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 534/1067] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:31.027391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29615a1a-e8ba-4d15-89cd-106ed506a56f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:31.110141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:31.123920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bb9b9-99a5-45a6-9068-035c4e574fb9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:31.175043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500b62-2c58-4d3d-85af-7fcad68f9ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:31.175953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500b62-2c58-4d3d-85af-7fcad68f9ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:31.177211 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500b62-2c58-4d3d-85af-7fcad68f9ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:31.177792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500b62-2c58-4d3d-85af-7fcad68f9ed7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:31.189902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27500b62-2c58-4d3d-85af-7fcad68f9ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:31.191110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29615a1a-e8ba-4d15-89cd-106ed506a56f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:31.192523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27500b62-2c58-4d3d-85af-7fcad68f9ed7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-27500b62-2c58-4d3d-85af-7fcad68f9ed7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:15:31.211786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:31.214438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:31.216440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 534/1068] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 26 07:15:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:31.219968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500b62-2c58-4d3d-85af-7fcad68f9ed7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:31.245914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:31.255288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2794c3-4a89-46a5-b06f-316032cc7862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:31.255933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2794c3-4a89-46a5-b06f-316032cc7862 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:31.256337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2794c3-4a89-46a5-b06f-316032cc7862 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:31.256519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2794c3-4a89-46a5-b06f-316032cc7862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:31.346372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2794c3-4a89-46a5-b06f-316032cc7862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:31.348084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2794c3-4a89-46a5-b06f-316032cc7862 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:31.357906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500b62-2c58-4d3d-85af-7fcad68f9ed7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:31.401448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261d1b8-58d4-4129-be67-913a4f7e38b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:31.402350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261d1b8-58d4-4129-be67-913a4f7e38b5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:31.402693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261d1b8-58d4-4129-be67-913a4f7e38b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:31.403057 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261d1b8-58d4-4129-be67-913a4f7e38b5 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:31.404500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261d1b8-58d4-4129-be67-913a4f7e38b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:31.405054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261d1b8-58d4-4129-be67-913a4f7e38b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:31.407848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261d1b8-58d4-4129-be67-913a4f7e38b5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:31.416877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:31.433081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 535/1069] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 26 07:15:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:31.439312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261d1b8-58d4-4129-be67-913a4f7e38b5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:31.493247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 535/1070] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:15:31.494874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2794c3-4a89-46a5-b06f-316032cc7862 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:31.549082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:31.586209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261d1b8-58d4-4129-be67-913a4f7e38b5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:31.623652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2794c3-4a89-46a5-b06f-316032cc7862 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:31.637174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5b3ad-ff8d-4e77-a188-464c9a855c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:31.639315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5b3ad-ff8d-4e77-a188-464c9a855c5e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:31.639315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5b3ad-ff8d-4e77-a188-464c9a855c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:31.639315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5b3ad-ff8d-4e77-a188-464c9a855c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:31.653639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5b3ad-ff8d-4e77-a188-464c9a855c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:31.655308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5b3ad-ff8d-4e77-a188-464c9a855c5e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1fe5b3ad-ff8d-4e77-a188-464c9a855c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:31.673333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:31.674855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:31.675944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:31.675944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:31.675944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:31.675944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:31.675944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 536/1071] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:31.681103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5b3ad-ff8d-4e77-a188-464c9a855c5e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:31.681585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3714e-8931-40ad-a00c-d9d9cdc530af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:31.682547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3714e-8931-40ad-a00c-d9d9cdc530af None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:31.682881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3714e-8931-40ad-a00c-d9d9cdc530af None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:31.683446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3714e-8931-40ad-a00c-d9d9cdc530af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:31.697852 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3714e-8931-40ad-a00c-d9d9cdc530af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:31.699448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3714e-8931-40ad-a00c-d9d9cdc530af None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d7d3714e-8931-40ad-a00c-d9d9cdc530af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:31.718797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:31.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:31.721112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:31.721112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:31.721112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:31.721112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:31.722044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 536/1072] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:31.726310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3714e-8931-40ad-a00c-d9d9cdc530af None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:31.736040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:31.848351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5b3ad-ff8d-4e77-a188-464c9a855c5e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:31.849495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3714e-8931-40ad-a00c-d9d9cdc530af None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:31.889349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f145c67-d01a-4307-9e3b-933f6b654bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:31.890537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145c67-d01a-4307-9e3b-933f6b654bbe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:31.891139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145c67-d01a-4307-9e3b-933f6b654bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:31.891581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145c67-d01a-4307-9e3b-933f6b654bbe None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:31.892742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f145c67-d01a-4307-9e3b-933f6b654bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:31.893213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f145c67-d01a-4307-9e3b-933f6b654bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:31.895148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:31.896999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f145c67-d01a-4307-9e3b-933f6b654bbe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:31.909498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eba0eb-4102-4ab2-827e-a623ec41389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:31.910435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba0eb-4102-4ab2-827e-a623ec41389f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:31.910874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba0eb-4102-4ab2-827e-a623ec41389f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:31.911292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba0eb-4102-4ab2-827e-a623ec41389f None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:31.912364 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eba0eb-4102-4ab2-827e-a623ec41389f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:31.912832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eba0eb-4102-4ab2-827e-a623ec41389f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:31.915060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eba0eb-4102-4ab2-827e-a623ec41389f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:31.921315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 537/1073] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:31.937351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 537/1074] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:31.943445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f145c67-d01a-4307-9e3b-933f6b654bbe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:32.043804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:32.098236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f145c67-d01a-4307-9e3b-933f6b654bbe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:32.151878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d825a-8cc7-4cb9-9eab-9761e165f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:32.152848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d825a-8cc7-4cb9-9eab-9761e165f711 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:32.153212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d825a-8cc7-4cb9-9eab-9761e165f711 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:32.153654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d825a-8cc7-4cb9-9eab-9761e165f711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:32.164921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d825a-8cc7-4cb9-9eab-9761e165f711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:32.167028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d825a-8cc7-4cb9-9eab-9761e165f711 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d48d825a-8cc7-4cb9-9eab-9761e165f711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:15:32.191119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:32.192175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:32.193154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:15:32.193154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:15:32.193154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:15:32.193154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:15:32.193154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:15:32.193154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:15:32.193154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:32.193154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:32.193743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 538/1075] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:32.193839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad38c9e-0c46-4a6b-b0d1-da9f2e0469ad None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:32.194438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad38c9e-0c46-4a6b-b0d1-da9f2e0469ad None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:32.194438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad38c9e-0c46-4a6b-b0d1-da9f2e0469ad None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:32.197402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 538/1076] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:32.200933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d825a-8cc7-4cb9-9eab-9761e165f711 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:32.201421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4f25-d187-4ff2-afd4-6f46906fca97 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:32.201705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4f25-d187-4ff2-afd4-6f46906fca97 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:32.201980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4f25-d187-4ff2-afd4-6f46906fca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:32.226759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fb4c4f25-d187-4ff2-afd4-6f46906fca97 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:32.228352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fb4c4f25-d187-4ff2-afd4-6f46906fca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:32.324527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 539/1077] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:32.338910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d825a-8cc7-4cb9-9eab-9761e165f711 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:32.348706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c4f25-d187-4ff2-afd4-6f46906fca97 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:32.372560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:32.386166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ba63d-9725-4f78-938d-808afc24e738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:32.386963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ba63d-9725-4f78-938d-808afc24e738 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:32.387268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ba63d-9725-4f78-938d-808afc24e738 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:32.387532 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ba63d-9725-4f78-938d-808afc24e738 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:32.388508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ba63d-9725-4f78-938d-808afc24e738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:32.389018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ba63d-9725-4f78-938d-808afc24e738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:32.390665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ba63d-9725-4f78-938d-808afc24e738 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:32.411426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 539/1078] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:32.412906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ba63d-9725-4f78-938d-808afc24e738 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:32.462768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c4f25-d187-4ff2-afd4-6f46906fca97 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:32.481393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:32.504664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7929bc-cc4c-42ff-a9e9-9a0fb200108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:32.505379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7929bc-cc4c-42ff-a9e9-9a0fb200108a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:32.505626 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7929bc-cc4c-42ff-a9e9-9a0fb200108a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:32.505894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7929bc-cc4c-42ff-a9e9-9a0fb200108a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:32.517897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7929bc-cc4c-42ff-a9e9-9a0fb200108a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4a7929bc-cc4c-42ff-a9e9-9a0fb200108a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:32.522899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:32.524485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:32.525508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 540/1079] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:32.530486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ba63d-9725-4f78-938d-808afc24e738 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:32.532486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7929bc-cc4c-42ff-a9e9-9a0fb200108a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:32.567895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a091-6e85-458b-8d10-ba412b0ed899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:32.568599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a091-6e85-458b-8d10-ba412b0ed899 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:32.569019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a091-6e85-458b-8d10-ba412b0ed899 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:32.569311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a091-6e85-458b-8d10-ba412b0ed899 None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/c70a0ca34a3940d1b067430c9c2dc64e/roles/aff1b21495a74c7fa12170715d44de2d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:32.571961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a091-6e85-458b-8d10-ba412b0ed899 None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=c70a0ca34a3940d1b067430c9c2dc64e, role_id=aff1b21495a74c7fa12170715d44de2d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:32.573590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a091-6e85-458b-8d10-ba412b0ed899 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:32.590918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 540/1080] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:15:32 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/c70a0ca34a3940d1b067430c9c2dc64e/roles/aff1b21495a74c7fa12170715d44de2d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:15:32.651252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7929bc-cc4c-42ff-a9e9-9a0fb200108a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:32.695397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f26763-9309-4686-b84f-77729c039e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:32.698677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f26763-9309-4686-b84f-77729c039e38 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:32.698677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f26763-9309-4686-b84f-77729c039e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:32.698677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f26763-9309-4686-b84f-77729c039e38 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:32.698677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f26763-9309-4686-b84f-77729c039e38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:32.698677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f26763-9309-4686-b84f-77729c039e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:32.699217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f26763-9309-4686-b84f-77729c039e38 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:32.709351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 541/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:15:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:32.715710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a091-6e85-458b-8d10-ba412b0ed899 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:32.770350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:32.838092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a091-6e85-458b-8d10-ba412b0ed899 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:32.888832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc659672-1455-4caa-84e7-677dec523840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:32.889914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659672-1455-4caa-84e7-677dec523840 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:32.890411 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659672-1455-4caa-84e7-677dec523840 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:32.890892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659672-1455-4caa-84e7-677dec523840 None admin] PATH_INFO: `/v3/users/b4151191052d419eb1aed8440ca53823` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:32.892940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc659672-1455-4caa-84e7-677dec523840 None admin] RBAC: Authorizing `identity:get_user(user_id=b4151191052d419eb1aed8440ca53823)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:32.895118 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc659672-1455-4caa-84e7-677dec523840 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:32.901994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 541/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:32 2022] GET /identity/v3/users/b4151191052d419eb1aed8440ca53823 => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:32.903955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f26763-9309-4686-b84f-77729c039e38 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:32.961401 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:33.039015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f26763-9309-4686-b84f-77729c039e38 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:33.087843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65ba36-7c91-4aba-8fbd-064696c46fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:33.088623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ba36-7c91-4aba-8fbd-064696c46fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:33.088920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ba36-7c91-4aba-8fbd-064696c46fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:33.089195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ba36-7c91-4aba-8fbd-064696c46fc1 None admin] PATH_INFO: `/v3/projects/7c2e0852cb824ef891e18cf68316b4ea` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:33.090604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65ba36-7c91-4aba-8fbd-064696c46fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=7c2e0852cb824ef891e18cf68316b4ea)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:33.092590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65ba36-7c91-4aba-8fbd-064696c46fc1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:33.094707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 542/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:15:32 2022] GET /identity/v3/projects/7c2e0852cb824ef891e18cf68316b4ea => generated 311 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:33.101016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc659672-1455-4caa-84e7-677dec523840 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:33.221061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc659672-1455-4caa-84e7-677dec523840 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:33.241386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:33.280055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4631eb-9994-4e53-9e31-6b7728d39c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:33.281383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4631eb-9994-4e53-9e31-6b7728d39c61 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:33.281873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4631eb-9994-4e53-9e31-6b7728d39c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:33.282212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4631eb-9994-4e53-9e31-6b7728d39c61 None admin] PATH_INFO: `/v3/projects/7c2e0852cb824ef891e18cf68316b4ea/users/b4151191052d419eb1aed8440ca53823/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:33.285686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4631eb-9994-4e53-9e31-6b7728d39c61 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c2e0852cb824ef891e18cf68316b4ea, user_id=b4151191052d419eb1aed8440ca53823, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:33.288381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4631eb-9994-4e53-9e31-6b7728d39c61 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:33.306112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 542/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:15:33 2022] PUT /identity/v3/projects/7c2e0852cb824ef891e18cf68316b4ea/users/b4151191052d419eb1aed8440ca53823/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:15:34.738751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde1054-ad7f-4d73-9923-d5b49a620572 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:34.739346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde1054-ad7f-4d73-9923-d5b49a620572 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:34.739727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde1054-ad7f-4d73-9923-d5b49a620572 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:34.742278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 543/1085] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:34.750576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccff935-4f88-4dd9-b10a-552db1b4709a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:34.751295 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccff935-4f88-4dd9-b10a-552db1b4709a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:34.751295 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccff935-4f88-4dd9-b10a-552db1b4709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:34.777866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3ccff935-4f88-4dd9-b10a-552db1b4709a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:34.779451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ccff935-4f88-4dd9-b10a-552db1b4709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:34.868090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 543/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:34.893529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde1054-ad7f-4d73-9923-d5b49a620572 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:35.011893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde1054-ad7f-4d73-9923-d5b49a620572 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:35.021052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:35.059105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b3339-9893-4f61-8f88-c5ae1fa8d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:35.059906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b3339-9893-4f61-8f88-c5ae1fa8d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:35.060322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b3339-9893-4f61-8f88-c5ae1fa8d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:35.060772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b3339-9893-4f61-8f88-c5ae1fa8d7d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:35.073977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b3339-9893-4f61-8f88-c5ae1fa8d7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-bd3b3339-9893-4f61-8f88-c5ae1fa8d7d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:35.079660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:35.081410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:35.083669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 544/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 26 07:15:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:35.087708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccff935-4f88-4dd9-b10a-552db1b4709a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:35.211303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccff935-4f88-4dd9-b10a-552db1b4709a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:35.213898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:35.252770 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b834b96-1a11-4cd4-8d11-9f8cc9244c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:35.253445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b834b96-1a11-4cd4-8d11-9f8cc9244c55 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:35.253773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b834b96-1a11-4cd4-8d11-9f8cc9244c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:35.254073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b834b96-1a11-4cd4-8d11-9f8cc9244c55 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:35.254863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b834b96-1a11-4cd4-8d11-9f8cc9244c55 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:35.255168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b834b96-1a11-4cd4-8d11-9f8cc9244c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:35.256565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b834b96-1a11-4cd4-8d11-9f8cc9244c55 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:35.265807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 544/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 26 07:15:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:35.272064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b3339-9893-4f61-8f88-c5ae1fa8d7d2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:35.328330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad9e9-664c-4e08-9551-5246d3de72eb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:35.328611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad9e9-664c-4e08-9551-5246d3de72eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:35.328884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad9e9-664c-4e08-9551-5246d3de72eb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:35.330490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 545/1089] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:15:35.337304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141c03-8823-4041-9258-f26afb10fbcb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:35.337675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141c03-8823-4041-9258-f26afb10fbcb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:35.338072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141c03-8823-4041-9258-f26afb10fbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:35.358847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ea141c03-8823-4041-9258-f26afb10fbcb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:35.360099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ea141c03-8823-4041-9258-f26afb10fbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:35.392280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b3339-9893-4f61-8f88-c5ae1fa8d7d2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:35.429245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23527902-7342-4068-bdcf-1913362db691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:35.429976 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23527902-7342-4068-bdcf-1913362db691 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:35.430292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23527902-7342-4068-bdcf-1913362db691 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:35.430582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23527902-7342-4068-bdcf-1913362db691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:35.441043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 546/1090] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:15:35.443341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23527902-7342-4068-bdcf-1913362db691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:35.444815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23527902-7342-4068-bdcf-1913362db691 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-23527902-7342-4068-bdcf-1913362db691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:35.460521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:35.463204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:35.465056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:35.465056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:35.465056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:35.465056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:35.465056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 545/1091] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:35.467221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141c03-8823-4041-9258-f26afb10fbcb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:35.467904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23527902-7342-4068-bdcf-1913362db691 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:35.497011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:35.579919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:35.589516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141c03-8823-4041-9258-f26afb10fbcb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:35.595734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23527902-7342-4068-bdcf-1913362db691 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:35.633393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e0147-2373-45b0-8eb6-b3e135f37479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:35.634246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e0147-2373-45b0-8eb6-b3e135f37479 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:35.634552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e0147-2373-45b0-8eb6-b3e135f37479 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:35.634800 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e0147-2373-45b0-8eb6-b3e135f37479 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:35.636025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e0147-2373-45b0-8eb6-b3e135f37479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:35.636357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e0147-2373-45b0-8eb6-b3e135f37479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:35.636831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d065d2-1f30-452a-8b85-5fd8f439d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:35.637530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d065d2-1f30-452a-8b85-5fd8f439d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:35.637888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d065d2-1f30-452a-8b85-5fd8f439d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:35.638201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d065d2-1f30-452a-8b85-5fd8f439d1f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:35.638519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e0147-2373-45b0-8eb6-b3e135f37479 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:35.650817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d065d2-1f30-452a-8b85-5fd8f439d1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:35.655783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 546/1092] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e0d065d2-1f30-452a-8b85-5fd8f439d1f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:35.657153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:35.658584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:35.660010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 547/1093] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:35.662698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e0147-2373-45b0-8eb6-b3e135f37479 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:35.666954 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d065d2-1f30-452a-8b85-5fd8f439d1f5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:35.754832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:35.779527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e0147-2373-45b0-8eb6-b3e135f37479 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:35.802955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d065d2-1f30-452a-8b85-5fd8f439d1f5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:35.822742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b7334-bdf8-4a8b-8056-d468dba83f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:35.823518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b7334-bdf8-4a8b-8056-d468dba83f2c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:35.823797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b7334-bdf8-4a8b-8056-d468dba83f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:35.824068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b7334-bdf8-4a8b-8056-d468dba83f2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:35.832573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b7334-bdf8-4a8b-8056-d468dba83f2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:35.834326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b7334-bdf8-4a8b-8056-d468dba83f2c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d30b7334-bdf8-4a8b-8056-d468dba83f2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:15:35.848343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:35.849774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:35.850746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 547/1094] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 26 07:15:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:35.858555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ed2f4-c51b-4722-b209-fcaf295d8f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:35.858990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ed2f4-c51b-4722-b209-fcaf295d8f32 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:35.859255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ed2f4-c51b-4722-b209-fcaf295d8f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:35.859453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b7334-bdf8-4a8b-8056-d468dba83f2c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:35.859731 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ed2f4-c51b-4722-b209-fcaf295d8f32 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:35.860671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ed2f4-c51b-4722-b209-fcaf295d8f32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:35.861112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ed2f4-c51b-4722-b209-fcaf295d8f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:35.862839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ed2f4-c51b-4722-b209-fcaf295d8f32 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:35.873483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 548/1095] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:35.879712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ed2f4-c51b-4722-b209-fcaf295d8f32 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:35.902283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:35.989655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ed2f4-c51b-4722-b209-fcaf295d8f32 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:36.001136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b7334-bdf8-4a8b-8056-d468dba83f2c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:36.037915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc51b77-b8eb-4533-ac34-76611dce482c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:36.038722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc51b77-b8eb-4533-ac34-76611dce482c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:36.039195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc51b77-b8eb-4533-ac34-76611dce482c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:36.039673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc51b77-b8eb-4533-ac34-76611dce482c None admin] PATH_INFO: `/v3/users/b4151191052d419eb1aed8440ca53823` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:36.041524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc51b77-b8eb-4533-ac34-76611dce482c None admin] RBAC: Authorizing `identity:get_user(user_id=b4151191052d419eb1aed8440ca53823)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:36.043388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc51b77-b8eb-4533-ac34-76611dce482c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:36.045974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 549/1096] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:35 2022] GET /identity/v3/users/b4151191052d419eb1aed8440ca53823 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:36.056651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7101-807b-456a-8535-bf292e7e09b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:36.057473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7101-807b-456a-8535-bf292e7e09b3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:36.057611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7101-807b-456a-8535-bf292e7e09b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:36.057900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7101-807b-456a-8535-bf292e7e09b3 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:36.058914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e7101-807b-456a-8535-bf292e7e09b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:36.059136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc51b77-b8eb-4533-ac34-76611dce482c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:36.059239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e7101-807b-456a-8535-bf292e7e09b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:36.060868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e7101-807b-456a-8535-bf292e7e09b3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:36.083836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:36.096103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 548/1097] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 26 07:15:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:36.102528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7101-807b-456a-8535-bf292e7e09b3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:36.173410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:36.191338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc51b77-b8eb-4533-ac34-76611dce482c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:36.235113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7101-807b-456a-8535-bf292e7e09b3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:36.235735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a41ca-e0be-4f1e-a242-082bb5950f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:36.236419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a41ca-e0be-4f1e-a242-082bb5950f6f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:36.236704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a41ca-e0be-4f1e-a242-082bb5950f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:36.237093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a41ca-e0be-4f1e-a242-082bb5950f6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:36.274764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eb4d3-dd97-40c3-8c66-102f004cc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:36.275568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eb4d3-dd97-40c3-8c66-102f004cc22c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:36.275848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eb4d3-dd97-40c3-8c66-102f004cc22c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:36.276118 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eb4d3-dd97-40c3-8c66-102f004cc22c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:36.310337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a41ca-e0be-4f1e-a242-082bb5950f6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:36.311689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a41ca-e0be-4f1e-a242-082bb5950f6f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:36.346770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:36.365078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eb4d3-dd97-40c3-8c66-102f004cc22c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:36.366589 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eb4d3-dd97-40c3-8c66-102f004cc22c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:36.411885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:36.430806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 550/1098] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:15:36.437206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a41ca-e0be-4f1e-a242-082bb5950f6f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:36.504087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 549/1099] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:15:36.510135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eb4d3-dd97-40c3-8c66-102f004cc22c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:36.579752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a41ca-e0be-4f1e-a242-082bb5950f6f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:36.615749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:36.623079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eb4d3-dd97-40c3-8c66-102f004cc22c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:36.628244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9da917-3a1e-4cc6-ada5-dbefb0b63ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:36.628906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9da917-3a1e-4cc6-ada5-dbefb0b63ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:36.629189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9da917-3a1e-4cc6-ada5-dbefb0b63ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:36.629497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9da917-3a1e-4cc6-ada5-dbefb0b63ce9 None admin] PATH_INFO: `/v3/projects/7c2e0852cb824ef891e18cf68316b4ea` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:36.630822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9da917-3a1e-4cc6-ada5-dbefb0b63ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=7c2e0852cb824ef891e18cf68316b4ea)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:36.632288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9da917-3a1e-4cc6-ada5-dbefb0b63ce9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:36.639124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 551/1100] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:15:36 2022] GET /identity/v3/projects/7c2e0852cb824ef891e18cf68316b4ea => generated 311 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:36.640406 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9da917-3a1e-4cc6-ada5-dbefb0b63ce9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:36.668423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbe19-b7c7-4b0b-a8df-4e4728f7f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:36.669123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbe19-b7c7-4b0b-a8df-4e4728f7f223 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:36.669445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbe19-b7c7-4b0b-a8df-4e4728f7f223 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:36.669740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbe19-b7c7-4b0b-a8df-4e4728f7f223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:36.681821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbe19-b7c7-4b0b-a8df-4e4728f7f223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:36.683311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbe19-b7c7-4b0b-a8df-4e4728f7f223 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5b3cbe19-b7c7-4b0b-a8df-4e4728f7f223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:15:36.700882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:36.702816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:36.704360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:15:36.704360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:15:36.704360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:15:36.704360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:36.704360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 550/1101] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:15:36.708878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:36.713500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbe19-b7c7-4b0b-a8df-4e4728f7f223 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:36.763070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9da917-3a1e-4cc6-ada5-dbefb0b63ce9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:36.800738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e2e83-2255-46dd-b6ed-0577f3be9b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:36.801412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e2e83-2255-46dd-b6ed-0577f3be9b1e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:36.801691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e2e83-2255-46dd-b6ed-0577f3be9b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:36.801961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e2e83-2255-46dd-b6ed-0577f3be9b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:36.802933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e2e83-2255-46dd-b6ed-0577f3be9b1e None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=7c2e0852cb824ef891e18cf68316b4ea, user.id=b4151191052d419eb1aed8440ca53823) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:36.803104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e2e83-2255-46dd-b6ed-0577f3be9b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:36.804517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e2e83-2255-46dd-b6ed-0577f3be9b1e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:36.811354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 552/1102] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:15:36 2022] GET /identity/v3/role_assignments?user.id=b4151191052d419eb1aed8440ca53823&scope.project.id=7c2e0852cb824ef891e18cf68316b4ea&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:36.837168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbe19-b7c7-4b0b-a8df-4e4728f7f223 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:36.880331 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbefda9-ee45-4279-b6b2-41edf929e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:36.881041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefda9-ee45-4279-b6b2-41edf929e336 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:36.881355 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefda9-ee45-4279-b6b2-41edf929e336 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:36.881632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefda9-ee45-4279-b6b2-41edf929e336 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:36.882353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbefda9-ee45-4279-b6b2-41edf929e336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:36.882660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbefda9-ee45-4279-b6b2-41edf929e336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:36.884108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbefda9-ee45-4279-b6b2-41edf929e336 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:36.899170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 551/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:36.905805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e2e83-2255-46dd-b6ed-0577f3be9b1e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:37.034602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e2e83-2255-46dd-b6ed-0577f3be9b1e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:37.054210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:37.074054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5996fe-0b6b-47ec-b70d-627229335a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:37.074734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5996fe-0b6b-47ec-b70d-627229335a28 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:37.075015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5996fe-0b6b-47ec-b70d-627229335a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:37.075289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5996fe-0b6b-47ec-b70d-627229335a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:37.082978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5996fe-0b6b-47ec-b70d-627229335a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:37.084461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5996fe-0b6b-47ec-b70d-627229335a28 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9e5996fe-0b6b-47ec-b70d-627229335a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:15:37.097742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:37.098792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:37.099749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:15:37.099749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:15:37.099749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:15:37.099749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:15:37.099749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:15:37.099749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:15:37.099749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:15:37.099749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:15:37.099749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 553/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:37.105798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbefda9-ee45-4279-b6b2-41edf929e336 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:37.118847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:37.230285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbefda9-ee45-4279-b6b2-41edf929e336 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:37.269965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c31f84-7fd4-4810-b44a-8593f40afbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:37.270613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c31f84-7fd4-4810-b44a-8593f40afbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:37.270892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c31f84-7fd4-4810-b44a-8593f40afbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:37.271161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c31f84-7fd4-4810-b44a-8593f40afbc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:37.271942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c31f84-7fd4-4810-b44a-8593f40afbc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:37.272248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c31f84-7fd4-4810-b44a-8593f40afbc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:37.273769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c31f84-7fd4-4810-b44a-8593f40afbc3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:37.287430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 552/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:37.293933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5996fe-0b6b-47ec-b70d-627229335a28 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:37.409282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5996fe-0b6b-47ec-b70d-627229335a28 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:37.450384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e547f-05a4-4596-9213-22e3d2e2d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:37.451012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e547f-05a4-4596-9213-22e3d2e2d250 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:37.451285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e547f-05a4-4596-9213-22e3d2e2d250 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:37.451554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e547f-05a4-4596-9213-22e3d2e2d250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:37.452347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e547f-05a4-4596-9213-22e3d2e2d250 None admin] RBAC: Adding query filter params (role.id=aff1b21495a74c7fa12170715d44de2d, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=c70a0ca34a3940d1b067430c9c2dc64e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:37.452668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e547f-05a4-4596-9213-22e3d2e2d250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:37.454156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e547f-05a4-4596-9213-22e3d2e2d250 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:37.460802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 554/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:15:37 2022] GET /identity/v3/role_assignments?user.id=c70a0ca34a3940d1b067430c9c2dc64e&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=aff1b21495a74c7fa12170715d44de2d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:38.892433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619064d-3f71-4726-ae29-4e6c9eda3fd9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:38.892978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619064d-3f71-4726-ae29-4e6c9eda3fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:38.892978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619064d-3f71-4726-ae29-4e6c9eda3fd9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:38.894582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 553/1107] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:38.900721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5da8a-ed38-4f8b-93c1-0eae7239c671 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:38.901521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5da8a-ed38-4f8b-93c1-0eae7239c671 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:38.902191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5da8a-ed38-4f8b-93c1-0eae7239c671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:38.922763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0ff5da8a-ed38-4f8b-93c1-0eae7239c671 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:38.924103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0ff5da8a-ed38-4f8b-93c1-0eae7239c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:38.961704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:38.995879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 555/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:39.020257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619064d-3f71-4726-ae29-4e6c9eda3fd9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:39.090368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:39.127116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619064d-3f71-4726-ae29-4e6c9eda3fd9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:39.167638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d9838-3b3d-4107-a69a-bb4ab575fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:39.168402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d9838-3b3d-4107-a69a-bb4ab575fa70 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:39.168688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d9838-3b3d-4107-a69a-bb4ab575fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:39.169001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d9838-3b3d-4107-a69a-bb4ab575fa70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:39.170675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d9838-3b3d-4107-a69a-bb4ab575fa70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:39.172500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d9838-3b3d-4107-a69a-bb4ab575fa70 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:39.174194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 554/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:39.180274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5da8a-ed38-4f8b-93c1-0eae7239c671 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:39.286092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5da8a-ed38-4f8b-93c1-0eae7239c671 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:39.321385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202d28c-a055-47be-af54-4c8241e3bf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:39.322005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d28c-a055-47be-af54-4c8241e3bf2d None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:39.322283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d28c-a055-47be-af54-4c8241e3bf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:39.322547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d28c-a055-47be-af54-4c8241e3bf2d None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:39.323234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202d28c-a055-47be-af54-4c8241e3bf2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:39.324672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202d28c-a055-47be-af54-4c8241e3bf2d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:39.348983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 556/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:15:39 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:41.382305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdccf2-e633-4edb-88ed-36f8a576b47e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:41.382909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdccf2-e633-4edb-88ed-36f8a576b47e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:41.382909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdccf2-e633-4edb-88ed-36f8a576b47e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:41.384221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 555/1111] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:41.389610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e734d85-3aee-4abc-8df4-081fe07021d1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:41.390033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e734d85-3aee-4abc-8df4-081fe07021d1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:41.390146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e734d85-3aee-4abc-8df4-081fe07021d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:41.409512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3e734d85-3aee-4abc-8df4-081fe07021d1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:41.410758 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3e734d85-3aee-4abc-8df4-081fe07021d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:41.436190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:41.482554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 557/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:41.505740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdccf2-e633-4edb-88ed-36f8a576b47e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:41.611875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdccf2-e633-4edb-88ed-36f8a576b47e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:41.647741 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32804d-cc1f-4354-a40b-0fefba0c9b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:41.648395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32804d-cc1f-4354-a40b-0fefba0c9b05 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:41.648673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32804d-cc1f-4354-a40b-0fefba0c9b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:41.648946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32804d-cc1f-4354-a40b-0fefba0c9b05 None admin] PATH_INFO: `/v3/roles/53cf1beeeaca4ae1b43e5399ce133329` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:41.650413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32804d-cc1f-4354-a40b-0fefba0c9b05 None admin] RBAC: Authorizing `identity:get_role(role_id=53cf1beeeaca4ae1b43e5399ce133329)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:41.651803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32804d-cc1f-4354-a40b-0fefba0c9b05 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:41.653227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 556/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:41 2022] GET /identity/v3/roles/53cf1beeeaca4ae1b43e5399ce133329 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:41.659424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e734d85-3aee-4abc-8df4-081fe07021d1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:41.765675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e734d85-3aee-4abc-8df4-081fe07021d1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:41.802418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb7daf-e0d9-4760-98b8-6313c9e04ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:41.803084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7daf-e0d9-4760-98b8-6313c9e04ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:41.803363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7daf-e0d9-4760-98b8-6313c9e04ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:41.803632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7daf-e0d9-4760-98b8-6313c9e04ab1 None admin] PATH_INFO: `/v3/users/b75bdf1ecd4e495db6a6b6014a093a28` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:41.818307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb7daf-e0d9-4760-98b8-6313c9e04ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=b75bdf1ecd4e495db6a6b6014a093a28)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:41.819760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb7daf-e0d9-4760-98b8-6313c9e04ab1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:41.821474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 558/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:41 2022] GET /identity/v3/users/b75bdf1ecd4e495db6a6b6014a093a28 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:41.827625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32804d-cc1f-4354-a40b-0fefba0c9b05 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:41.831919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:41.933362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32804d-cc1f-4354-a40b-0fefba0c9b05 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:41.969095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7a68-cda7-4196-b800-60064e373635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:41.969804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7a68-cda7-4196-b800-60064e373635 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:41.970086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7a68-cda7-4196-b800-60064e373635 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:41.970395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7a68-cda7-4196-b800-60064e373635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:42.041588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d7a68-cda7-4196-b800-60064e373635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:42.043055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d7a68-cda7-4196-b800-60064e373635 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:42.045880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:42.163568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 557/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:15:42.170934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb7daf-e0d9-4760-98b8-6313c9e04ab1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:42.193615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:42.286430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb7daf-e0d9-4760-98b8-6313c9e04ab1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:42.321404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55784652-df71-4b7b-8e59-a2e50ca2d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:42.322142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55784652-df71-4b7b-8e59-a2e50ca2d83c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:42.322499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55784652-df71-4b7b-8e59-a2e50ca2d83c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:42.322776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55784652-df71-4b7b-8e59-a2e50ca2d83c None admin] PATH_INFO: `/v3/projects/7c2e0852cb824ef891e18cf68316b4ea` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:42.323974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55784652-df71-4b7b-8e59-a2e50ca2d83c None admin] RBAC: Authorizing `identity:get_project(project_id=7c2e0852cb824ef891e18cf68316b4ea)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:42.325448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55784652-df71-4b7b-8e59-a2e50ca2d83c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:42.327148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 559/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:15:42 2022] GET /identity/v3/projects/7c2e0852cb824ef891e18cf68316b4ea => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:42.333655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7a68-cda7-4196-b800-60064e373635 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:42.439310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7a68-cda7-4196-b800-60064e373635 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:42.441755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:42.475610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529d416-b006-483e-9cc2-ad6e86a86afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:42.476148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529d416-b006-483e-9cc2-ad6e86a86afb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:42.476424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529d416-b006-483e-9cc2-ad6e86a86afb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:42.476696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529d416-b006-483e-9cc2-ad6e86a86afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:42.477516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529d416-b006-483e-9cc2-ad6e86a86afb None admin] RBAC: Adding query filter params (role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=7c2e0852cb824ef891e18cf68316b4ea, user.id=b75bdf1ecd4e495db6a6b6014a093a28) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:42.477827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529d416-b006-483e-9cc2-ad6e86a86afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:42.479271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529d416-b006-483e-9cc2-ad6e86a86afb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:42.485035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 558/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:15:42 2022] GET /identity/v3/role_assignments?user.id=b75bdf1ecd4e495db6a6b6014a093a28&scope.project.id=7c2e0852cb824ef891e18cf68316b4ea&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:44.458376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066fb8-b629-4b84-bc4a-031cc59ac25a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:44.459000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066fb8-b629-4b84-bc4a-031cc59ac25a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:44.459000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066fb8-b629-4b84-bc4a-031cc59ac25a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:44.460320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 560/1118] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:44.466218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a35b5a-e0a2-4d72-8259-3617905f7195 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:44.467156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a35b5a-e0a2-4d72-8259-3617905f7195 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:44.467156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a35b5a-e0a2-4d72-8259-3617905f7195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:44.486586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-86a35b5a-e0a2-4d72-8259-3617905f7195 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:44.487831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-86a35b5a-e0a2-4d72-8259-3617905f7195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:44.565824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 559/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:44.588705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f066fb8-b629-4b84-bc4a-031cc59ac25a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:44.684425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:44.703703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f066fb8-b629-4b84-bc4a-031cc59ac25a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:44.740777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2710-0023-4857-81ee-66930c535b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:44.741377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2710-0023-4857-81ee-66930c535b31 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:44.741661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2710-0023-4857-81ee-66930c535b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:44.741936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2710-0023-4857-81ee-66930c535b31 None admin] PATH_INFO: `/v3/roles/53cf1beeeaca4ae1b43e5399ce133329` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:44.743428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2710-0023-4857-81ee-66930c535b31 None admin] RBAC: Authorizing `identity:get_role(role_id=53cf1beeeaca4ae1b43e5399ce133329)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:44.744804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2710-0023-4857-81ee-66930c535b31 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:44.746212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 561/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:44 2022] GET /identity/v3/roles/53cf1beeeaca4ae1b43e5399ce133329 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:44.752374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a35b5a-e0a2-4d72-8259-3617905f7195 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:44.852415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:44.856612 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a35b5a-e0a2-4d72-8259-3617905f7195 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:44.892810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9e287-b6f3-4b6c-9b0e-f7847583af42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:44.893484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9e287-b6f3-4b6c-9b0e-f7847583af42 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:44.893762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9e287-b6f3-4b6c-9b0e-f7847583af42 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:44.894028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9e287-b6f3-4b6c-9b0e-f7847583af42 None admin] PATH_INFO: `/v3/users/b75bdf1ecd4e495db6a6b6014a093a28` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:44.895241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9e287-b6f3-4b6c-9b0e-f7847583af42 None admin] RBAC: Authorizing `identity:get_user(user_id=b75bdf1ecd4e495db6a6b6014a093a28)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:44.896696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9e287-b6f3-4b6c-9b0e-f7847583af42 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:44.898360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 560/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:44 2022] GET /identity/v3/users/b75bdf1ecd4e495db6a6b6014a093a28 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:44.904615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2710-0023-4857-81ee-66930c535b31 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:45.008307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2710-0023-4857-81ee-66930c535b31 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:45.044554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d71a6-58db-46ef-9735-a7952bbcd01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:45.045201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d71a6-58db-46ef-9735-a7952bbcd01b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:45.045514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d71a6-58db-46ef-9735-a7952bbcd01b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:45.045791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d71a6-58db-46ef-9735-a7952bbcd01b None admin] PATH_INFO: `/v3/projects/7c2e0852cb824ef891e18cf68316b4ea` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:45.047030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d71a6-58db-46ef-9735-a7952bbcd01b None admin] RBAC: Authorizing `identity:get_project(project_id=7c2e0852cb824ef891e18cf68316b4ea)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:45.048544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d71a6-58db-46ef-9735-a7952bbcd01b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:45.050277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 562/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:15:44 2022] GET /identity/v3/projects/7c2e0852cb824ef891e18cf68316b4ea => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:45.056743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9e287-b6f3-4b6c-9b0e-f7847583af42 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:45.164335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9e287-b6f3-4b6c-9b0e-f7847583af42 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:45.199386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e67f8-17e6-413c-942e-247760f689c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:45.200062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e67f8-17e6-413c-942e-247760f689c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:45.200342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e67f8-17e6-413c-942e-247760f689c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:45.200614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e67f8-17e6-413c-942e-247760f689c9 None admin] PATH_INFO: `/v3/projects/7c2e0852cb824ef891e18cf68316b4ea/users/b75bdf1ecd4e495db6a6b6014a093a28/roles/53cf1beeeaca4ae1b43e5399ce133329` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:45.203024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e67f8-17e6-413c-942e-247760f689c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c2e0852cb824ef891e18cf68316b4ea, user_id=b75bdf1ecd4e495db6a6b6014a093a28, role_id=53cf1beeeaca4ae1b43e5399ce133329)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:45.204474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e67f8-17e6-413c-942e-247760f689c9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:45.218587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 561/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:15:45 2022] PUT /identity/v3/projects/7c2e0852cb824ef891e18cf68316b4ea/users/b75bdf1ecd4e495db6a6b6014a093a28/roles/53cf1beeeaca4ae1b43e5399ce133329 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:15:47.183648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c753a9-3567-4258-bfa0-f30c636148f9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:47.184234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c753a9-3567-4258-bfa0-f30c636148f9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:47.184234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c753a9-3567-4258-bfa0-f30c636148f9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:47.185846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 563/1124] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:47.191674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcefdb8-3a10-4053-adb8-9cb2502fe044 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:47.192146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcefdb8-3a10-4053-adb8-9cb2502fe044 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:47.192241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcefdb8-3a10-4053-adb8-9cb2502fe044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:47.212423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-efcefdb8-3a10-4053-adb8-9cb2502fe044 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:47.213682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-efcefdb8-3a10-4053-adb8-9cb2502fe044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:47.235902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:47.287604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 562/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:47.311239 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c753a9-3567-4258-bfa0-f30c636148f9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:47.334876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:47.419999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c753a9-3567-4258-bfa0-f30c636148f9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:47.455747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2d43-c0ac-4843-b3ea-d91b51b0f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:47.456303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2d43-c0ac-4843-b3ea-d91b51b0f2da None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:47.456580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2d43-c0ac-4843-b3ea-d91b51b0f2da None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:47.456849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2d43-c0ac-4843-b3ea-d91b51b0f2da None admin] PATH_INFO: `/v3/roles/53cf1beeeaca4ae1b43e5399ce133329` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:47.458331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b2d43-c0ac-4843-b3ea-d91b51b0f2da None admin] RBAC: Authorizing `identity:get_role(role_id=53cf1beeeaca4ae1b43e5399ce133329)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:47.459727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b2d43-c0ac-4843-b3ea-d91b51b0f2da None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:47.461229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 564/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:47 2022] GET /identity/v3/roles/53cf1beeeaca4ae1b43e5399ce133329 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:47.467720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcefdb8-3a10-4053-adb8-9cb2502fe044 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:47.567957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcefdb8-3a10-4053-adb8-9cb2502fe044 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:47.603241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73510e9-4575-4ad6-a612-c967168cd672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:47.603884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73510e9-4575-4ad6-a612-c967168cd672 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:47.604156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73510e9-4575-4ad6-a612-c967168cd672 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:47.604421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73510e9-4575-4ad6-a612-c967168cd672 None admin] PATH_INFO: `/v3/users/b75bdf1ecd4e495db6a6b6014a093a28` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:47.605648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73510e9-4575-4ad6-a612-c967168cd672 None admin] RBAC: Authorizing `identity:get_user(user_id=b75bdf1ecd4e495db6a6b6014a093a28)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:47.607090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73510e9-4575-4ad6-a612-c967168cd672 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:47.608698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 563/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:47 2022] GET /identity/v3/users/b75bdf1ecd4e495db6a6b6014a093a28 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:47.614870 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2d43-c0ac-4843-b3ea-d91b51b0f2da None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:47.711285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:47.727226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2d43-c0ac-4843-b3ea-d91b51b0f2da None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:47.761719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910adc5-33d0-4b4a-a4e6-b1df3ec444d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:47.762335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910adc5-33d0-4b4a-a4e6-b1df3ec444d0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:47.762613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910adc5-33d0-4b4a-a4e6-b1df3ec444d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:47.762884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910adc5-33d0-4b4a-a4e6-b1df3ec444d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:47.831870 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910adc5-33d0-4b4a-a4e6-b1df3ec444d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:47.833463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910adc5-33d0-4b4a-a4e6-b1df3ec444d0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:47.924931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:47.939342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 565/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:15:47.945649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73510e9-4575-4ad6-a612-c967168cd672 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:47.973168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:48.077279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73510e9-4575-4ad6-a612-c967168cd672 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:48.113627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a64e1-5071-4adb-b1fa-0246307c9fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:48.114278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a64e1-5071-4adb-b1fa-0246307c9fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:48.114546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a64e1-5071-4adb-b1fa-0246307c9fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:48.114814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a64e1-5071-4adb-b1fa-0246307c9fc7 None admin] PATH_INFO: `/v3/projects/7c2e0852cb824ef891e18cf68316b4ea` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:48.115967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a64e1-5071-4adb-b1fa-0246307c9fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=7c2e0852cb824ef891e18cf68316b4ea)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:48.117452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a64e1-5071-4adb-b1fa-0246307c9fc7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:48.119131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 564/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:15:47 2022] GET /identity/v3/projects/7c2e0852cb824ef891e18cf68316b4ea => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:48.126001 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910adc5-33d0-4b4a-a4e6-b1df3ec444d0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:48.230819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910adc5-33d0-4b4a-a4e6-b1df3ec444d0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:48.266513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2105e-9e30-4b62-b8a3-3d2f7fe928fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:48.267164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2105e-9e30-4b62-b8a3-3d2f7fe928fb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:48.267448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2105e-9e30-4b62-b8a3-3d2f7fe928fb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:48.267721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2105e-9e30-4b62-b8a3-3d2f7fe928fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:48.268515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2105e-9e30-4b62-b8a3-3d2f7fe928fb None admin] RBAC: Adding query filter params (role.id=53cf1beeeaca4ae1b43e5399ce133329, scope.project.id=7c2e0852cb824ef891e18cf68316b4ea, user.id=b75bdf1ecd4e495db6a6b6014a093a28) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:48.268801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2105e-9e30-4b62-b8a3-3d2f7fe928fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:48.270290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2105e-9e30-4b62-b8a3-3d2f7fe928fb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:48.276183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 566/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:15:48 2022] GET /identity/v3/role_assignments?user.id=b75bdf1ecd4e495db6a6b6014a093a28&scope.project.id=7c2e0852cb824ef891e18cf68316b4ea&role.id=53cf1beeeaca4ae1b43e5399ce133329 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:50.301124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf3aa-7e6e-4819-bb98-834b5a735fbc None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:50.301780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf3aa-7e6e-4819-bb98-834b5a735fbc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:50.301780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf3aa-7e6e-4819-bb98-834b5a735fbc None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:50.303086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 565/1131] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:50.308505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f78df-27eb-4ca4-b3f8-477808fa2eff None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:50.308995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f78df-27eb-4ca4-b3f8-477808fa2eff None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:50.309108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f78df-27eb-4ca4-b3f8-477808fa2eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:50.328738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-992f78df-27eb-4ca4-b3f8-477808fa2eff None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:50.330054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-992f78df-27eb-4ca4-b3f8-477808fa2eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:50.379216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:50.401146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 567/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:50.424639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf3aa-7e6e-4819-bb98-834b5a735fbc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:50.518240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:50.528379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf3aa-7e6e-4819-bb98-834b5a735fbc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:50.562873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34b7e2-4d86-4842-ac6d-be5ee704eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:50.563435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34b7e2-4d86-4842-ac6d-be5ee704eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:50.563706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34b7e2-4d86-4842-ac6d-be5ee704eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:50.564170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34b7e2-4d86-4842-ac6d-be5ee704eaf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:50.565397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34b7e2-4d86-4842-ac6d-be5ee704eaf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:50.566829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34b7e2-4d86-4842-ac6d-be5ee704eaf8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:50.568427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 566/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:50.574644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f78df-27eb-4ca4-b3f8-477808fa2eff None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:50.677841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f78df-27eb-4ca4-b3f8-477808fa2eff None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:50.713151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827e33e-6e19-43f8-a675-fa51eeff02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:50.713808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827e33e-6e19-43f8-a675-fa51eeff02ea None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:50.714090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827e33e-6e19-43f8-a675-fa51eeff02ea None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:50.714366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827e33e-6e19-43f8-a675-fa51eeff02ea None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:50.715057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827e33e-6e19-43f8-a675-fa51eeff02ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:50.716848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827e33e-6e19-43f8-a675-fa51eeff02ea None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:50.746142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 568/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:15:50 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:52.801391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0c0cc-2684-44a0-a105-3975f2cf5683 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:52.801987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0c0cc-2684-44a0-a105-3975f2cf5683 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:52.801987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0c0cc-2684-44a0-a105-3975f2cf5683 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:52.803321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 567/1135] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:52.808659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3172-b042-4840-ad86-3f5271eb7578 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:52.809079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3172-b042-4840-ad86-3f5271eb7578 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:52.809170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3172-b042-4840-ad86-3f5271eb7578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:52.828328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-df6a3172-b042-4840-ad86-3f5271eb7578 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:52.829579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df6a3172-b042-4840-ad86-3f5271eb7578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:52.858206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:52.902547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 569/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:52.927110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0c0cc-2684-44a0-a105-3975f2cf5683 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:53.036843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0c0cc-2684-44a0-a105-3975f2cf5683 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:53.074915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ace3a2-3f28-4d34-8809-ca1a3b635049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:53.075563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ace3a2-3f28-4d34-8809-ca1a3b635049 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:53.075841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ace3a2-3f28-4d34-8809-ca1a3b635049 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:53.076114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ace3a2-3f28-4d34-8809-ca1a3b635049 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:53.077367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ace3a2-3f28-4d34-8809-ca1a3b635049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:53.078810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ace3a2-3f28-4d34-8809-ca1a3b635049 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:53.080552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 568/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:15:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:53.086826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a3172-b042-4840-ad86-3f5271eb7578 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:53.191456 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a3172-b042-4840-ad86-3f5271eb7578 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:53.226680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d7162-7794-4e0b-8197-ab69dc23d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:53.227298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7162-7794-4e0b-8197-ab69dc23d8ae None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:53.227576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7162-7794-4e0b-8197-ab69dc23d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:53.227845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7162-7794-4e0b-8197-ab69dc23d8ae None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:53.228528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d7162-7794-4e0b-8197-ab69dc23d8ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:53.229986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d7162-7794-4e0b-8197-ab69dc23d8ae None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:53.253232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 570/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:15:53 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:15:55.317566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890b3f-0021-48d2-b46e-39d60526bafd None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:55.318179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890b3f-0021-48d2-b46e-39d60526bafd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:55.318179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890b3f-0021-48d2-b46e-39d60526bafd None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:55.319488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 569/1139] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:55.325544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0626-e9be-4638-a7ad-b1076b8af976 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:55.325990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0626-e9be-4638-a7ad-b1076b8af976 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:55.326082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0626-e9be-4638-a7ad-b1076b8af976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:55.344959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-147e0626-e9be-4638-a7ad-b1076b8af976 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:55.346213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-147e0626-e9be-4638-a7ad-b1076b8af976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:55.361196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:55.423335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 571/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:55.446403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b890b3f-0021-48d2-b46e-39d60526bafd None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:55.477955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:55.560289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b890b3f-0021-48d2-b46e-39d60526bafd None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:55.598451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b18b60-0dcd-4093-8d9f-0c69d2c7cbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:55.599001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b18b60-0dcd-4093-8d9f-0c69d2c7cbfa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:55.599277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b18b60-0dcd-4093-8d9f-0c69d2c7cbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:55.599548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b18b60-0dcd-4093-8d9f-0c69d2c7cbfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:55.614197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b18b60-0dcd-4093-8d9f-0c69d2c7cbfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-35b18b60-0dcd-4093-8d9f-0c69d2c7cbfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:55.623113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:55.624876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:55.626984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 570/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:55.633782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e0626-e9be-4638-a7ad-b1076b8af976 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:55.742364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e0626-e9be-4638-a7ad-b1076b8af976 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:55.779895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1437b5-ac35-4254-ba28-6a940db5f306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:55.780561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1437b5-ac35-4254-ba28-6a940db5f306 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:55.780840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1437b5-ac35-4254-ba28-6a940db5f306 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:55.781118 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1437b5-ac35-4254-ba28-6a940db5f306 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:55.781892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1437b5-ac35-4254-ba28-6a940db5f306 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:55.782197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1437b5-ac35-4254-ba28-6a940db5f306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:55.783659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1437b5-ac35-4254-ba28-6a940db5f306 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:55.792894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 572/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:55.799109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b18b60-0dcd-4093-8d9f-0c69d2c7cbfa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:55.893485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:55.906983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b18b60-0dcd-4093-8d9f-0c69d2c7cbfa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:55.943461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8e1a-68eb-40b1-a1fa-081a386e1dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:55.944114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8e1a-68eb-40b1-a1fa-081a386e1dcc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:55.944389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8e1a-68eb-40b1-a1fa-081a386e1dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:55.944661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8e1a-68eb-40b1-a1fa-081a386e1dcc None admin] PATH_INFO: `/v3/users/588187cdee244393b732f7eeccaae79e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:55.960851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e8e1a-68eb-40b1-a1fa-081a386e1dcc None admin] RBAC: Authorizing `identity:get_user(user_id=588187cdee244393b732f7eeccaae79e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:55.962844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e8e1a-68eb-40b1-a1fa-081a386e1dcc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:55.965350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 571/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:55 2022] GET /identity/v3/users/588187cdee244393b732f7eeccaae79e => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:55.972744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1437b5-ac35-4254-ba28-6a940db5f306 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:55.988950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:56.075991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1437b5-ac35-4254-ba28-6a940db5f306 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:56.111702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70c8f-cfbd-4621-8a5e-fca42dfc5afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:56.112327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70c8f-cfbd-4621-8a5e-fca42dfc5afe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:56.112607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70c8f-cfbd-4621-8a5e-fca42dfc5afe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:56.112884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70c8f-cfbd-4621-8a5e-fca42dfc5afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:56.183244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef70c8f-cfbd-4621-8a5e-fca42dfc5afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:56.184604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef70c8f-cfbd-4621-8a5e-fca42dfc5afe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:56.198328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:56.288829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 573/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:15:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:15:56.295306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8e1a-68eb-40b1-a1fa-081a386e1dcc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:56.409534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8e1a-68eb-40b1-a1fa-081a386e1dcc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:56.445174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37823794-f85c-492c-8b6d-544b4b2e0fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:56.445854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37823794-f85c-492c-8b6d-544b4b2e0fff None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:56.446133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37823794-f85c-492c-8b6d-544b4b2e0fff None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:56.446405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37823794-f85c-492c-8b6d-544b4b2e0fff None admin] PATH_INFO: `/v3/projects/83dcb461e2214fb58bc3a1cc45193d32` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:56.447618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37823794-f85c-492c-8b6d-544b4b2e0fff None admin] RBAC: Authorizing `identity:get_project(project_id=83dcb461e2214fb58bc3a1cc45193d32)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:56.449075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37823794-f85c-492c-8b6d-544b4b2e0fff None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:56.450859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 572/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:15:56 2022] GET /identity/v3/projects/83dcb461e2214fb58bc3a1cc45193d32 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:56.457371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70c8f-cfbd-4621-8a5e-fca42dfc5afe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:56.566769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70c8f-cfbd-4621-8a5e-fca42dfc5afe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:56.581799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:56.604040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c472269-c5cf-41ff-9f09-42b24feb66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:56.604674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c472269-c5cf-41ff-9f09-42b24feb66b9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:56.604953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c472269-c5cf-41ff-9f09-42b24feb66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:56.605229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c472269-c5cf-41ff-9f09-42b24feb66b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:56.606073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c472269-c5cf-41ff-9f09-42b24feb66b9 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=83dcb461e2214fb58bc3a1cc45193d32, user.id=588187cdee244393b732f7eeccaae79e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:56.606383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c472269-c5cf-41ff-9f09-42b24feb66b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:56.607825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c472269-c5cf-41ff-9f09-42b24feb66b9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:56.613767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 574/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:15:56 2022] GET /identity/v3/role_assignments?user.id=588187cdee244393b732f7eeccaae79e&scope.project.id=83dcb461e2214fb58bc3a1cc45193d32&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:58.613512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433011fa-9173-4fb3-8223-7c1909c2eac1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:58.614172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433011fa-9173-4fb3-8223-7c1909c2eac1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:58.614172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433011fa-9173-4fb3-8223-7c1909c2eac1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:58.615499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 573/1147] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:15:58.621332 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f31424-8bb4-4ddb-940c-69e226c59638 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:58.621868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f31424-8bb4-4ddb-940c-69e226c59638 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:58.621868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f31424-8bb4-4ddb-940c-69e226c59638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:58.642828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-86f31424-8bb4-4ddb-940c-69e226c59638 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:15:58.644069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-86f31424-8bb4-4ddb-940c-69e226c59638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:15:58.715446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 575/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:15:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:15:58.738764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433011fa-9173-4fb3-8223-7c1909c2eac1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:58.755866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:58.851514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433011fa-9173-4fb3-8223-7c1909c2eac1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:58.889022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b63efd-db25-4789-af26-97cea06b1fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:58.889614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b63efd-db25-4789-af26-97cea06b1fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:58.889893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b63efd-db25-4789-af26-97cea06b1fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:58.890151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b63efd-db25-4789-af26-97cea06b1fc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:58.900651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b63efd-db25-4789-af26-97cea06b1fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a3b63efd-db25-4789-af26-97cea06b1fc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:15:58.905625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:15:58.911937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:15:58.913172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 574/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:15:58.914161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f31424-8bb4-4ddb-940c-69e226c59638 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:59.018421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f31424-8bb4-4ddb-940c-69e226c59638 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:59.026577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:59.056172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c5ee0-d2b4-4e4d-992c-9c08dede0938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:59.056815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c5ee0-d2b4-4e4d-992c-9c08dede0938 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:59.057088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c5ee0-d2b4-4e4d-992c-9c08dede0938 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:59.057400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c5ee0-d2b4-4e4d-992c-9c08dede0938 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:59.058166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c5ee0-d2b4-4e4d-992c-9c08dede0938 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:15:59.058466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c5ee0-d2b4-4e4d-992c-9c08dede0938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:59.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c5ee0-d2b4-4e4d-992c-9c08dede0938 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:59.070557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 576/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:15:59.077297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b63efd-db25-4789-af26-97cea06b1fc0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:59.157432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:15:59.183634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b63efd-db25-4789-af26-97cea06b1fc0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:59.220816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1bd11-27cc-4c82-b99a-6f889b8d9a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:59.221528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1bd11-27cc-4c82-b99a-6f889b8d9a38 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:59.221802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1bd11-27cc-4c82-b99a-6f889b8d9a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:59.222074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1bd11-27cc-4c82-b99a-6f889b8d9a38 None admin] PATH_INFO: `/v3/users/588187cdee244393b732f7eeccaae79e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:59.223453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1bd11-27cc-4c82-b99a-6f889b8d9a38 None admin] RBAC: Authorizing `identity:get_user(user_id=588187cdee244393b732f7eeccaae79e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:59.224931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1bd11-27cc-4c82-b99a-6f889b8d9a38 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:59.226776 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 575/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:15:59 2022] GET /identity/v3/users/588187cdee244393b732f7eeccaae79e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:59.233496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c5ee0-d2b4-4e4d-992c-9c08dede0938 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:59.360936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c5ee0-d2b4-4e4d-992c-9c08dede0938 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:59.398051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627a34-1a9c-44a3-aafe-9fa49dfcedee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:59.398702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627a34-1a9c-44a3-aafe-9fa49dfcedee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:59.398978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627a34-1a9c-44a3-aafe-9fa49dfcedee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:59.399248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627a34-1a9c-44a3-aafe-9fa49dfcedee None admin] PATH_INFO: `/v3/projects/83dcb461e2214fb58bc3a1cc45193d32` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:59.400493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627a34-1a9c-44a3-aafe-9fa49dfcedee None admin] RBAC: Authorizing `identity:get_project(project_id=83dcb461e2214fb58bc3a1cc45193d32)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:59.401957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627a34-1a9c-44a3-aafe-9fa49dfcedee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:59.403699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 577/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:15:59 2022] GET /identity/v3/projects/83dcb461e2214fb58bc3a1cc45193d32 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:15:59.410281 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1bd11-27cc-4c82-b99a-6f889b8d9a38 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:15:59.514861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1bd11-27cc-4c82-b99a-6f889b8d9a38 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:15:59.550511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d709f-1b02-4733-a2a3-48f2f425c536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:15:59.551195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d709f-1b02-4733-a2a3-48f2f425c536 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:15:59.551476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d709f-1b02-4733-a2a3-48f2f425c536 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:15:59.551742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d709f-1b02-4733-a2a3-48f2f425c536 None admin] PATH_INFO: `/v3/projects/83dcb461e2214fb58bc3a1cc45193d32/users/588187cdee244393b732f7eeccaae79e/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:15:59.553819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d709f-1b02-4733-a2a3-48f2f425c536 None admin] RBAC: Authorizing `identity:create_grant(project_id=83dcb461e2214fb58bc3a1cc45193d32, user_id=588187cdee244393b732f7eeccaae79e, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:15:59.555253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d709f-1b02-4733-a2a3-48f2f425c536 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:15:59.570532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 576/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:15:59 2022] PUT /identity/v3/projects/83dcb461e2214fb58bc3a1cc45193d32/users/588187cdee244393b732f7eeccaae79e/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:16:01.720785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397874cc-39ce-4e52-be61-ed28b20c2088 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:01.721401 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397874cc-39ce-4e52-be61-ed28b20c2088 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:01.721401 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397874cc-39ce-4e52-be61-ed28b20c2088 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:01.722796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 578/1154] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:16:01.729076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be824e49-d667-42c7-9e9e-1305d6c8d7cb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:01.729742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be824e49-d667-42c7-9e9e-1305d6c8d7cb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:01.729742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be824e49-d667-42c7-9e9e-1305d6c8d7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:01.737620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:01.755500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-be824e49-d667-42c7-9e9e-1305d6c8d7cb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:16:01.756825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-be824e49-d667-42c7-9e9e-1305d6c8d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:16:01.835857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 577/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:16:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:16:01.862252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397874cc-39ce-4e52-be61-ed28b20c2088 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:01.904385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:01.994949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397874cc-39ce-4e52-be61-ed28b20c2088 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:02.032044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95214667-897d-449e-a670-b491bea4aec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:02.032742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95214667-897d-449e-a670-b491bea4aec9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:02.033046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95214667-897d-449e-a670-b491bea4aec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:02.033432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95214667-897d-449e-a670-b491bea4aec9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:02.045800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95214667-897d-449e-a670-b491bea4aec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-95214667-897d-449e-a670-b491bea4aec9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:16:02.057168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:16:02.058623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:16:02.059907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 579/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:16:02.065929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be824e49-d667-42c7-9e9e-1305d6c8d7cb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:02.184236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be824e49-d667-42c7-9e9e-1305d6c8d7cb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:02.218360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:02.223845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aef91a-0ea9-4a80-948c-44b6426bf60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:02.224480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aef91a-0ea9-4a80-948c-44b6426bf60b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:02.224758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aef91a-0ea9-4a80-948c-44b6426bf60b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:02.225019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aef91a-0ea9-4a80-948c-44b6426bf60b None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:02.225785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aef91a-0ea9-4a80-948c-44b6426bf60b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:16:02.226089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aef91a-0ea9-4a80-948c-44b6426bf60b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:02.227472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aef91a-0ea9-4a80-948c-44b6426bf60b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:02.236982 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 578/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:16:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:02.243431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95214667-897d-449e-a670-b491bea4aec9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:02.340407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:02.347583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95214667-897d-449e-a670-b491bea4aec9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:02.387615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6f0a3-12f3-44a0-b2b6-459af702b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:02.388916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6f0a3-12f3-44a0-b2b6-459af702b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:02.389546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6f0a3-12f3-44a0-b2b6-459af702b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:02.390121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6f0a3-12f3-44a0-b2b6-459af702b6d1 None admin] PATH_INFO: `/v3/users/588187cdee244393b732f7eeccaae79e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:02.392548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6f0a3-12f3-44a0-b2b6-459af702b6d1 None admin] RBAC: Authorizing `identity:get_user(user_id=588187cdee244393b732f7eeccaae79e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:02.395846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6f0a3-12f3-44a0-b2b6-459af702b6d1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:02.398929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 580/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:16:02 2022] GET /identity/v3/users/588187cdee244393b732f7eeccaae79e => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:02.405105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aef91a-0ea9-4a80-948c-44b6426bf60b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:02.526058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aef91a-0ea9-4a80-948c-44b6426bf60b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:02.565016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e161c-82a2-4571-a437-1d08e47f9f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:02.565690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e161c-82a2-4571-a437-1d08e47f9f08 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:02.566002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e161c-82a2-4571-a437-1d08e47f9f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:02.566277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e161c-82a2-4571-a437-1d08e47f9f08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:02.645252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:02.654407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e161c-82a2-4571-a437-1d08e47f9f08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:02.655910 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e161c-82a2-4571-a437-1d08e47f9f08 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:02.775994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 579/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:16:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:16:02.785591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6f0a3-12f3-44a0-b2b6-459af702b6d1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:02.904054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6f0a3-12f3-44a0-b2b6-459af702b6d1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:02.941681 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6451b77-3728-4aa2-b6e5-f9841262b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:02.942372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6451b77-3728-4aa2-b6e5-f9841262b268 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:02.942646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6451b77-3728-4aa2-b6e5-f9841262b268 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:02.942913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6451b77-3728-4aa2-b6e5-f9841262b268 None admin] PATH_INFO: `/v3/projects/83dcb461e2214fb58bc3a1cc45193d32` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:02.944132 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6451b77-3728-4aa2-b6e5-f9841262b268 None admin] RBAC: Authorizing `identity:get_project(project_id=83dcb461e2214fb58bc3a1cc45193d32)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:02.945608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6451b77-3728-4aa2-b6e5-f9841262b268 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:02.947347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 581/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:16:02 2022] GET /identity/v3/projects/83dcb461e2214fb58bc3a1cc45193d32 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:02.955960 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e161c-82a2-4571-a437-1d08e47f9f08 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:03.090424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:03.099381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e161c-82a2-4571-a437-1d08e47f9f08 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:03.142381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2025d-4d3c-4a15-bdad-60dd92061ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:03.143180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2025d-4d3c-4a15-bdad-60dd92061ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:03.143496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2025d-4d3c-4a15-bdad-60dd92061ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:03.143806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2025d-4d3c-4a15-bdad-60dd92061ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:03.144814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2025d-4d3c-4a15-bdad-60dd92061ba9 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=83dcb461e2214fb58bc3a1cc45193d32, user.id=588187cdee244393b732f7eeccaae79e) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:16:03.145233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2025d-4d3c-4a15-bdad-60dd92061ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:03.147003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2025d-4d3c-4a15-bdad-60dd92061ba9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:03.155069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 580/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:16:02 2022] GET /identity/v3/role_assignments?user.id=588187cdee244393b732f7eeccaae79e&scope.project.id=83dcb461e2214fb58bc3a1cc45193d32&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:05.257399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f24e7d-daed-4ab5-a407-c886bef5b057 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:05.258022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f24e7d-daed-4ab5-a407-c886bef5b057 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:05.258022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f24e7d-daed-4ab5-a407-c886bef5b057 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:05.259311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 582/1162] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:16:05.265344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553dbb7-1d4a-47c0-93e4-fc07ed3282b0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:05.265793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553dbb7-1d4a-47c0-93e4-fc07ed3282b0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:05.265978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553dbb7-1d4a-47c0-93e4-fc07ed3282b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:05.286469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3553dbb7-1d4a-47c0-93e4-fc07ed3282b0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:16:05.287822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3553dbb7-1d4a-47c0-93e4-fc07ed3282b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:16:05.367029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 581/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:16:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:16:05.391092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f24e7d-daed-4ab5-a407-c886bef5b057 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:05.432982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:05.514427 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f24e7d-daed-4ab5-a407-c886bef5b057 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:05.547888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4771e3-8a0b-41ba-bb95-01ba9a7536fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:05.548549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4771e3-8a0b-41ba-bb95-01ba9a7536fd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:05.548800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4771e3-8a0b-41ba-bb95-01ba9a7536fd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:05.549105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4771e3-8a0b-41ba-bb95-01ba9a7536fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:05.622645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4771e3-8a0b-41ba-bb95-01ba9a7536fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:05.624108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4771e3-8a0b-41ba-bb95-01ba9a7536fd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:05.654290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:05.731183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 583/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:16:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:16:05.740064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553dbb7-1d4a-47c0-93e4-fc07ed3282b0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:05.832342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:05.846980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553dbb7-1d4a-47c0-93e4-fc07ed3282b0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:05.882880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2dc96-7cd9-40cf-aa2d-ce6864766163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:05.883531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2dc96-7cd9-40cf-aa2d-ce6864766163 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:05.883811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2dc96-7cd9-40cf-aa2d-ce6864766163 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:05.884088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2dc96-7cd9-40cf-aa2d-ce6864766163 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:05.891498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2dc96-7cd9-40cf-aa2d-ce6864766163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:05.893061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2dc96-7cd9-40cf-aa2d-ce6864766163 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-79d2dc96-7cd9-40cf-aa2d-ce6864766163 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:16:05.905508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:16:05.906911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:16:05.908250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 582/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:16:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:16:05.914144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4771e3-8a0b-41ba-bb95-01ba9a7536fd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:06.025829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4771e3-8a0b-41ba-bb95-01ba9a7536fd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:06.061986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:06.068188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea448c1-2e52-4b3a-8981-58be7160a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:06.069986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea448c1-2e52-4b3a-8981-58be7160a254 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:06.069986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea448c1-2e52-4b3a-8981-58be7160a254 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:06.069986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea448c1-2e52-4b3a-8981-58be7160a254 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:06.070349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea448c1-2e52-4b3a-8981-58be7160a254 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:16:06.070435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea448c1-2e52-4b3a-8981-58be7160a254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:06.071970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea448c1-2e52-4b3a-8981-58be7160a254 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:06.081045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 584/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 26 07:16:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:08.318857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde74b-9f29-4ed6-b63a-ff926d95add6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:08.319481 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde74b-9f29-4ed6-b63a-ff926d95add6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:08.319481 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde74b-9f29-4ed6-b63a-ff926d95add6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:08.320859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 583/1167] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:16:08.327107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7839-8596-4c72-b842-719c1ecc3af5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:08.327737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7839-8596-4c72-b842-719c1ecc3af5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:08.327737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7839-8596-4c72-b842-719c1ecc3af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:08.349592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c63e7839-8596-4c72-b842-719c1ecc3af5 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:16:08.350891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c63e7839-8596-4c72-b842-719c1ecc3af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:16:08.430826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 585/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:16:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:16:08.453905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde74b-9f29-4ed6-b63a-ff926d95add6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:08.566991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde74b-9f29-4ed6-b63a-ff926d95add6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:08.603042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af03563-7e45-4f05-a8e8-49897ef1d144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:08.603574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af03563-7e45-4f05-a8e8-49897ef1d144 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:08.603850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af03563-7e45-4f05-a8e8-49897ef1d144 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:08.604120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af03563-7e45-4f05-a8e8-49897ef1d144 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:08.604834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af03563-7e45-4f05-a8e8-49897ef1d144 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:08.606242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af03563-7e45-4f05-a8e8-49897ef1d144 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:08.630282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 584/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Tue Jul 26 07:16:08 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:16:10.682919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f4608-d4fd-448e-b26b-b5f8994ea6ca None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:10.683472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f4608-d4fd-448e-b26b-b5f8994ea6ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:10.683472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f4608-d4fd-448e-b26b-b5f8994ea6ca None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:10.684814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 586/1170] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:16:10.690418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5c625-0b5f-4764-ba84-14ea978e1ca1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:10.690860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5c625-0b5f-4764-ba84-14ea978e1ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:10.690964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5c625-0b5f-4764-ba84-14ea978e1ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:10.710236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fcf5c625-0b5f-4764-ba84-14ea978e1ca1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:16:10.711454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fcf5c625-0b5f-4764-ba84-14ea978e1ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:16:10.713507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:10.786140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 585/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:16:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:16:10.809863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f4608-d4fd-448e-b26b-b5f8994ea6ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:10.917680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f4608-d4fd-448e-b26b-b5f8994ea6ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:10.944593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:10.954094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bb798-01f7-4938-b18c-c5cf1283bf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:10.954799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bb798-01f7-4938-b18c-c5cf1283bf02 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:10.955085 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bb798-01f7-4938-b18c-c5cf1283bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:10.955360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bb798-01f7-4938-b18c-c5cf1283bf02 None admin] PATH_INFO: `/v3/domains/a7a89a562688444fb74011bf62e6cd4c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:10.965797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bb798-01f7-4938-b18c-c5cf1283bf02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7a89a562688444fb74011bf62e6cd4c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:10.967643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bb798-01f7-4938-b18c-c5cf1283bf02 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:10.969302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 587/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Jul 26 07:16:10 2022] GET /identity/v3/domains/a7a89a562688444fb74011bf62e6cd4c => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:10.975624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5c625-0b5f-4764-ba84-14ea978e1ca1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:11.077746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5c625-0b5f-4764-ba84-14ea978e1ca1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:11.112797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0054b-012f-42d0-be3b-feb5e7271cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:11.113438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0054b-012f-42d0-be3b-feb5e7271cad None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:11.113713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0054b-012f-42d0-be3b-feb5e7271cad None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:11.113966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0054b-012f-42d0-be3b-feb5e7271cad None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:11.114654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0054b-012f-42d0-be3b-feb5e7271cad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:11.116112 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0054b-012f-42d0-be3b-feb5e7271cad None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:11.125497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:11.147368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 586/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:16:10 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:16:13.221003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42ee3d-b6f8-4858-94e5-684e5e961f72 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:13.221635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42ee3d-b6f8-4858-94e5-684e5e961f72 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:13.221635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42ee3d-b6f8-4858-94e5-684e5e961f72 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:13.222945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 588/1174] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:16:13.228269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0ce0-bacc-4da2-978a-3976e91e73a7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:13.228691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0ce0-bacc-4da2-978a-3976e91e73a7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:13.228783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0ce0-bacc-4da2-978a-3976e91e73a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:13.247387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dd7a0ce0-bacc-4da2-978a-3976e91e73a7 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:16:13.248588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dd7a0ce0-bacc-4da2-978a-3976e91e73a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:16:13.319094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 587/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:16:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:16:13.344009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42ee3d-b6f8-4858-94e5-684e5e961f72 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:13.455243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42ee3d-b6f8-4858-94e5-684e5e961f72 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:13.490998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c607a9-69fb-46bc-96a7-d493796a4a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:13.491569 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c607a9-69fb-46bc-96a7-d493796a4a50 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:13.491849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c607a9-69fb-46bc-96a7-d493796a4a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:13.492124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c607a9-69fb-46bc-96a7-d493796a4a50 None admin] PATH_INFO: `/v3/domains/a7a89a562688444fb74011bf62e6cd4c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:13.493301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c607a9-69fb-46bc-96a7-d493796a4a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7a89a562688444fb74011bf62e6cd4c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:13.494760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c607a9-69fb-46bc-96a7-d493796a4a50 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:13.496383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 589/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Jul 26 07:16:13 2022] GET /identity/v3/domains/a7a89a562688444fb74011bf62e6cd4c => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:13.502473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a0ce0-bacc-4da2-978a-3976e91e73a7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:13.605752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a0ce0-bacc-4da2-978a-3976e91e73a7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:13.626607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:13.647029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ff4ab-d9fb-404b-833b-fa850424220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:13.647663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ff4ab-d9fb-404b-833b-fa850424220e None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:13.647937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ff4ab-d9fb-404b-833b-fa850424220e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:13.648205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ff4ab-d9fb-404b-833b-fa850424220e None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:13.648914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ff4ab-d9fb-404b-833b-fa850424220e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:13.650396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ff4ab-d9fb-404b-833b-fa850424220e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:13.674901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 588/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:16:13 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:16:15.741570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379cce-93ec-435a-9d89-9c118e73fe55 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:15.742160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379cce-93ec-435a-9d89-9c118e73fe55 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:15.742160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379cce-93ec-435a-9d89-9c118e73fe55 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:15.743458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 590/1178] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:16:15.748843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330ae7d-17ed-4c63-970a-0705274dc7a2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:15.749312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330ae7d-17ed-4c63-970a-0705274dc7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:15.749425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330ae7d-17ed-4c63-970a-0705274dc7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:15.768753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a330ae7d-17ed-4c63-970a-0705274dc7a2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:16:15.770008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a330ae7d-17ed-4c63-970a-0705274dc7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:16:15.839983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 589/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:16:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:16:15.864153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379cce-93ec-435a-9d89-9c118e73fe55 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:15.923707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:15.973545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379cce-93ec-435a-9d89-9c118e73fe55 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:16.012475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bb1d2-57b2-4f02-a2c4-6dbe1941c90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:16.013161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bb1d2-57b2-4f02-a2c4-6dbe1941c90f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:16.013483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bb1d2-57b2-4f02-a2c4-6dbe1941c90f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:16.013759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bb1d2-57b2-4f02-a2c4-6dbe1941c90f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:16.027740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bb1d2-57b2-4f02-a2c4-6dbe1941c90f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-657bb1d2-57b2-4f02-a2c4-6dbe1941c90f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:16:16.033387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:16:16.034560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:16:16.035564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:16:16.038263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 591/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:16:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:16:16.042199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330ae7d-17ed-4c63-970a-0705274dc7a2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:16.151478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330ae7d-17ed-4c63-970a-0705274dc7a2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:16.159524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:16.187577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f901c-405e-4129-b51e-01ddbaffd78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:16.188214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f901c-405e-4129-b51e-01ddbaffd78f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:16.188499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f901c-405e-4129-b51e-01ddbaffd78f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:16.188825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f901c-405e-4129-b51e-01ddbaffd78f None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:16.189583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f901c-405e-4129-b51e-01ddbaffd78f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:16:16.189863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f901c-405e-4129-b51e-01ddbaffd78f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:16.191279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f901c-405e-4129-b51e-01ddbaffd78f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:16.199650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 590/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:16:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:16.207433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bb1d2-57b2-4f02-a2c4-6dbe1941c90f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:16.309842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bb1d2-57b2-4f02-a2c4-6dbe1941c90f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:16.324787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:16.347614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17093d3-17a2-45c9-a37f-a958461e77ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:16.348262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17093d3-17a2-45c9-a37f-a958461e77ab None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:16.348543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17093d3-17a2-45c9-a37f-a958461e77ab None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:16.348817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17093d3-17a2-45c9-a37f-a958461e77ab None admin] PATH_INFO: `/v3/users/d23715b916c1484aa9863c530ceab0db` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:16.362610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17093d3-17a2-45c9-a37f-a958461e77ab None admin] RBAC: Authorizing `identity:get_user(user_id=d23715b916c1484aa9863c530ceab0db)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:16.364060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17093d3-17a2-45c9-a37f-a958461e77ab None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:16.365764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 592/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:16:16 2022] GET /identity/v3/users/d23715b916c1484aa9863c530ceab0db => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:16.372105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f901c-405e-4129-b51e-01ddbaffd78f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:16.490660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f901c-405e-4129-b51e-01ddbaffd78f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:16.529460 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d587c74-c90d-4a2b-8de4-69c00e6c386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:16.530101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d587c74-c90d-4a2b-8de4-69c00e6c386f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:16.530376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d587c74-c90d-4a2b-8de4-69c00e6c386f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:16.530653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d587c74-c90d-4a2b-8de4-69c00e6c386f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:16.570258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:16.609532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d587c74-c90d-4a2b-8de4-69c00e6c386f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:16.610993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d587c74-c90d-4a2b-8de4-69c00e6c386f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:16.722568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 591/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:16:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:16:16.728904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17093d3-17a2-45c9-a37f-a958461e77ab None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:16.838261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17093d3-17a2-45c9-a37f-a958461e77ab None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:16.874166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a384744-9844-4b06-9cc6-6657f51078aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:16.874817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a384744-9844-4b06-9cc6-6657f51078aa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:16.875085 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a384744-9844-4b06-9cc6-6657f51078aa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:16.875360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a384744-9844-4b06-9cc6-6657f51078aa None admin] PATH_INFO: `/v3/projects/2050b8f5d1d74424989bb805da036c66` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:16.876598 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a384744-9844-4b06-9cc6-6657f51078aa None admin] RBAC: Authorizing `identity:get_project(project_id=2050b8f5d1d74424989bb805da036c66)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:16.878064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a384744-9844-4b06-9cc6-6657f51078aa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:16.879764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 593/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:16:16 2022] GET /identity/v3/projects/2050b8f5d1d74424989bb805da036c66 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:16.886261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d587c74-c90d-4a2b-8de4-69c00e6c386f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:16.967656 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:17.008785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d587c74-c90d-4a2b-8de4-69c00e6c386f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:17.045050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7824227-c866-4322-9458-de90cc471123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:17.045698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824227-c866-4322-9458-de90cc471123 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:17.045975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824227-c866-4322-9458-de90cc471123 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:17.046246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824227-c866-4322-9458-de90cc471123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:17.047045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824227-c866-4322-9458-de90cc471123 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=2050b8f5d1d74424989bb805da036c66, user.id=d23715b916c1484aa9863c530ceab0db) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:16:17.047353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824227-c866-4322-9458-de90cc471123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:17.048904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824227-c866-4322-9458-de90cc471123 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:17.054997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 592/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:16:16 2022] GET /identity/v3/role_assignments?user.id=d23715b916c1484aa9863c530ceab0db&scope.project.id=2050b8f5d1d74424989bb805da036c66&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:19.069367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f60607-0845-4994-abfa-43d51f19a3ef None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:19.069989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f60607-0845-4994-abfa-43d51f19a3ef None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:19.069989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f60607-0845-4994-abfa-43d51f19a3ef None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:19.071275 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 594/1186] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:16:19.076931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494566e-733c-451d-848a-40b93fd295cb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:19.077382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494566e-733c-451d-848a-40b93fd295cb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:19.077493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494566e-733c-451d-848a-40b93fd295cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:19.097587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2494566e-733c-451d-848a-40b93fd295cb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:16:19.098961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2494566e-733c-451d-848a-40b93fd295cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:16:19.178171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 593/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:16:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:16:19.201231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f60607-0845-4994-abfa-43d51f19a3ef None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:19.247534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:19.311971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f60607-0845-4994-abfa-43d51f19a3ef None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:19.352890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273f824-cadc-4d6f-84fe-87c58a242378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:19.353496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273f824-cadc-4d6f-84fe-87c58a242378 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:19.353778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273f824-cadc-4d6f-84fe-87c58a242378 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:19.354048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273f824-cadc-4d6f-84fe-87c58a242378 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:19.365476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273f824-cadc-4d6f-84fe-87c58a242378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9273f824-cadc-4d6f-84fe-87c58a242378 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:16:19.370474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:16:19.371654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:16:19.372818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 595/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:16:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:16:19.378804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494566e-733c-451d-848a-40b93fd295cb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:19.453673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:19.496523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494566e-733c-451d-848a-40b93fd295cb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:19.531895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c387b-90f4-4647-9e55-dd414c5b0787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:19.532566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c387b-90f4-4647-9e55-dd414c5b0787 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:19.532846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c387b-90f4-4647-9e55-dd414c5b0787 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:19.533130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c387b-90f4-4647-9e55-dd414c5b0787 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:19.533920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c387b-90f4-4647-9e55-dd414c5b0787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:16:19.534230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c387b-90f4-4647-9e55-dd414c5b0787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:19.535605 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c387b-90f4-4647-9e55-dd414c5b0787 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:19.543492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 594/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:16:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:19.549775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273f824-cadc-4d6f-84fe-87c58a242378 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:19.652202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:19.655507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273f824-cadc-4d6f-84fe-87c58a242378 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:19.693591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce97eb-78a8-47c1-87ee-8ca8f2bebf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:19.694252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce97eb-78a8-47c1-87ee-8ca8f2bebf35 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:19.694538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce97eb-78a8-47c1-87ee-8ca8f2bebf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:19.694811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce97eb-78a8-47c1-87ee-8ca8f2bebf35 None admin] PATH_INFO: `/v3/users/d23715b916c1484aa9863c530ceab0db` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:19.696002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce97eb-78a8-47c1-87ee-8ca8f2bebf35 None admin] RBAC: Authorizing `identity:get_user(user_id=d23715b916c1484aa9863c530ceab0db)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:19.697471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce97eb-78a8-47c1-87ee-8ca8f2bebf35 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:19.699127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 596/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:16:19 2022] GET /identity/v3/users/d23715b916c1484aa9863c530ceab0db => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:19.705208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c387b-90f4-4647-9e55-dd414c5b0787 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:19.837054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c387b-90f4-4647-9e55-dd414c5b0787 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:19.864569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:19.876090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d22aaa-ad46-43b7-89de-fb49d1c61a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:19.876754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d22aaa-ad46-43b7-89de-fb49d1c61a4a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:19.877033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d22aaa-ad46-43b7-89de-fb49d1c61a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:19.877329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d22aaa-ad46-43b7-89de-fb49d1c61a4a None admin] PATH_INFO: `/v3/projects/2050b8f5d1d74424989bb805da036c66` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:19.878511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d22aaa-ad46-43b7-89de-fb49d1c61a4a None admin] RBAC: Authorizing `identity:get_project(project_id=2050b8f5d1d74424989bb805da036c66)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:19.879952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d22aaa-ad46-43b7-89de-fb49d1c61a4a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:19.881708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 595/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:16:19 2022] GET /identity/v3/projects/2050b8f5d1d74424989bb805da036c66 => generated 361 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:19.888104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce97eb-78a8-47c1-87ee-8ca8f2bebf35 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:19.992714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce97eb-78a8-47c1-87ee-8ca8f2bebf35 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:20.028424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e178b2-6146-4c8b-8070-25a2e0e7c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:20.029092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e178b2-6146-4c8b-8070-25a2e0e7c9ee None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:20.029405 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e178b2-6146-4c8b-8070-25a2e0e7c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:20.029685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e178b2-6146-4c8b-8070-25a2e0e7c9ee None admin] PATH_INFO: `/v3/projects/2050b8f5d1d74424989bb805da036c66/users/d23715b916c1484aa9863c530ceab0db/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:20.031746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e178b2-6146-4c8b-8070-25a2e0e7c9ee None admin] RBAC: Authorizing `identity:create_grant(project_id=2050b8f5d1d74424989bb805da036c66, user_id=d23715b916c1484aa9863c530ceab0db, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:20.033183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e178b2-6146-4c8b-8070-25a2e0e7c9ee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:20.053630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 597/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:16:19 2022] PUT /identity/v3/projects/2050b8f5d1d74424989bb805da036c66/users/d23715b916c1484aa9863c530ceab0db/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:16:22.048290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908cb26-de65-4dbf-9f61-7a356d588e1b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:22.048901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908cb26-de65-4dbf-9f61-7a356d588e1b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:22.048901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908cb26-de65-4dbf-9f61-7a356d588e1b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:22.050257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 596/1193] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:16:22.055774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe075f5-4326-428e-9f59-df9c39b8b373 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:22.056242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe075f5-4326-428e-9f59-df9c39b8b373 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:22.056420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe075f5-4326-428e-9f59-df9c39b8b373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:22.075833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cbe075f5-4326-428e-9f59-df9c39b8b373 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:16:22.077024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cbe075f5-4326-428e-9f59-df9c39b8b373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:16:22.101855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:22.167311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 598/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:16:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:16:22.195923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908cb26-de65-4dbf-9f61-7a356d588e1b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:22.307292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908cb26-de65-4dbf-9f61-7a356d588e1b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:22.340539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11638c7c-73e3-433b-a5e3-8ccb691a1191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:22.341585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11638c7c-73e3-433b-a5e3-8ccb691a1191 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:22.341864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11638c7c-73e3-433b-a5e3-8ccb691a1191 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:22.342134 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11638c7c-73e3-433b-a5e3-8ccb691a1191 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:22.353140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11638c7c-73e3-433b-a5e3-8ccb691a1191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-11638c7c-73e3-433b-a5e3-8ccb691a1191 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:16:22.358085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:16:22.359248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:16:22.360212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 597/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:16:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:16:22.365735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe075f5-4326-428e-9f59-df9c39b8b373 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:22.471006 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe075f5-4326-428e-9f59-df9c39b8b373 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:22.505813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4095535-86b8-4ce1-a633-9d7127f2847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:22.506442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4095535-86b8-4ce1-a633-9d7127f2847a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:22.506703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4095535-86b8-4ce1-a633-9d7127f2847a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:22.506981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4095535-86b8-4ce1-a633-9d7127f2847a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:22.507700 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4095535-86b8-4ce1-a633-9d7127f2847a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:16:22.507998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4095535-86b8-4ce1-a633-9d7127f2847a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:22.509393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4095535-86b8-4ce1-a633-9d7127f2847a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:22.517857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 599/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:16:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:22.523958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11638c7c-73e3-433b-a5e3-8ccb691a1191 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:22.587230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:22.638148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11638c7c-73e3-433b-a5e3-8ccb691a1191 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:22.675481 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b87d-97bf-422d-a4a0-c2cca76daaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:22.676217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b87d-97bf-422d-a4a0-c2cca76daaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:22.676541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b87d-97bf-422d-a4a0-c2cca76daaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:22.676890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b87d-97bf-422d-a4a0-c2cca76daaa1 None admin] PATH_INFO: `/v3/users/d23715b916c1484aa9863c530ceab0db` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:22.678217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6b87d-97bf-422d-a4a0-c2cca76daaa1 None admin] RBAC: Authorizing `identity:get_user(user_id=d23715b916c1484aa9863c530ceab0db)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:22.679745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6b87d-97bf-422d-a4a0-c2cca76daaa1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:22.681521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 598/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 26 07:16:22 2022] GET /identity/v3/users/d23715b916c1484aa9863c530ceab0db => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:22.687798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4095535-86b8-4ce1-a633-9d7127f2847a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:22.712575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:22.800705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4095535-86b8-4ce1-a633-9d7127f2847a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:22.836683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02860e-49b3-4fd7-aa74-7fde6ac1b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:22.837377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02860e-49b3-4fd7-aa74-7fde6ac1b3ee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:22.837587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02860e-49b3-4fd7-aa74-7fde6ac1b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:22.837889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02860e-49b3-4fd7-aa74-7fde6ac1b3ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:22.908262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02860e-49b3-4fd7-aa74-7fde6ac1b3ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:22.909768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02860e-49b3-4fd7-aa74-7fde6ac1b3ee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:22.931320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:23.024451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 600/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:16:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:16:23.031019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b87d-97bf-422d-a4a0-c2cca76daaa1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:23.139994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b87d-97bf-422d-a4a0-c2cca76daaa1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:23.160773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:23.178785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bbe0f-fbc2-4d85-b982-40bb799d46be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:23.179440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bbe0f-fbc2-4d85-b982-40bb799d46be None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:23.179720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bbe0f-fbc2-4d85-b982-40bb799d46be None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:23.179993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bbe0f-fbc2-4d85-b982-40bb799d46be None admin] PATH_INFO: `/v3/projects/2050b8f5d1d74424989bb805da036c66` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:23.181209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bbe0f-fbc2-4d85-b982-40bb799d46be None admin] RBAC: Authorizing `identity:get_project(project_id=2050b8f5d1d74424989bb805da036c66)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:23.182688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bbe0f-fbc2-4d85-b982-40bb799d46be None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:23.184417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 599/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 26 07:16:23 2022] GET /identity/v3/projects/2050b8f5d1d74424989bb805da036c66 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:23.191945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02860e-49b3-4fd7-aa74-7fde6ac1b3ee None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:16:23.300690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02860e-49b3-4fd7-aa74-7fde6ac1b3ee None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:16:23.322352 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:23.338633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5cb57-5946-4b7b-ba14-382803f001c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:16:23.339321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5cb57-5946-4b7b-ba14-382803f001c8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:16:23.339650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5cb57-5946-4b7b-ba14-382803f001c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:16:23.339972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5cb57-5946-4b7b-ba14-382803f001c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:16:23.341191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5cb57-5946-4b7b-ba14-382803f001c8 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=2050b8f5d1d74424989bb805da036c66, user.id=d23715b916c1484aa9863c530ceab0db) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:16:23.341531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5cb57-5946-4b7b-ba14-382803f001c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:16:23.342962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5cb57-5946-4b7b-ba14-382803f001c8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:16:23.349529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 601/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:16:23 2022] GET /identity/v3/role_assignments?user.id=d23715b916c1484aa9863c530ceab0db&scope.project.id=2050b8f5d1d74424989bb805da036c66&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:16:33.174140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:16:33.346439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:19.956610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d7080-901c-44e3-b467-47a1f94d4660 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:19.957236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d7080-901c-44e3-b467-47a1f94d4660 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:19.957236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d7080-901c-44e3-b467-47a1f94d4660 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:19.958819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 600/1201] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:19.964305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ad2ff-2e69-4aff-a66f-c3d11766d233 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:19.965205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ad2ff-2e69-4aff-a66f-c3d11766d233 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:19.965205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ad2ff-2e69-4aff-a66f-c3d11766d233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:19.987094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5c1ad2ff-2e69-4aff-a66f-c3d11766d233 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:19.988322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5c1ad2ff-2e69-4aff-a66f-c3d11766d233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:20.089109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 602/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:20.117136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d7080-901c-44e3-b467-47a1f94d4660 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:20.269168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d7080-901c-44e3-b467-47a1f94d4660 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:20.324204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416da1f-3fe9-4158-9d05-f11228f9dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:20.324863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416da1f-3fe9-4158-9d05-f11228f9dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:20.325143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416da1f-3fe9-4158-9d05-f11228f9dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:20.325451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416da1f-3fe9-4158-9d05-f11228f9dbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:20.337164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416da1f-3fe9-4158-9d05-f11228f9dbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:20.338685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416da1f-3fe9-4158-9d05-f11228f9dbd8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5416da1f-3fe9-4158-9d05-f11228f9dbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:20.355295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:20.357386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:20.358387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:20.358387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:20.358387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:20.358387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:20.358387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 601/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:17:20.363076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ad2ff-2e69-4aff-a66f-c3d11766d233 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:20.502785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ad2ff-2e69-4aff-a66f-c3d11766d233 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:20.547130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:20.555263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25ee17-35fd-4eb5-881b-4f91819ddd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:20.556043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ee17-35fd-4eb5-881b-4f91819ddd57 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:20.556355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ee17-35fd-4eb5-881b-4f91819ddd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:20.556635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ee17-35fd-4eb5-881b-4f91819ddd57 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:20.557450 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ee17-35fd-4eb5-881b-4f91819ddd57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:20.558233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ee17-35fd-4eb5-881b-4f91819ddd57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:20.559804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ee17-35fd-4eb5-881b-4f91819ddd57 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:20.575585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 603/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:20.582164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416da1f-3fe9-4158-9d05-f11228f9dbd8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:20.662265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:20.743801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416da1f-3fe9-4158-9d05-f11228f9dbd8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:20.799108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9c0c9-b9e3-412b-8109-4d423f4eea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:20.799769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c0c9-b9e3-412b-8109-4d423f4eea05 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:20.800091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c0c9-b9e3-412b-8109-4d423f4eea05 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:20.800367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c0c9-b9e3-412b-8109-4d423f4eea05 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:20.801120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9c0c9-b9e3-412b-8109-4d423f4eea05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:20.802852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9c0c9-b9e3-412b-8109-4d423f4eea05 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:20.835129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 602/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 26 07:17:20 2022] POST /identity/v3/users => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:17:23.313812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a086a07-9488-4a1c-827b-7521f96e0237 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:23.314409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a086a07-9488-4a1c-827b-7521f96e0237 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:23.314409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a086a07-9488-4a1c-827b-7521f96e0237 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:23.316159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 604/1206] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:23.323992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0b42-0a2b-4f17-abdd-9b612a57073c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:23.324643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0b42-0a2b-4f17-abdd-9b612a57073c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:23.324805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0b42-0a2b-4f17-abdd-9b612a57073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:23.354354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f3db0b42-0a2b-4f17-abdd-9b612a57073c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:23.355671 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f3db0b42-0a2b-4f17-abdd-9b612a57073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:23.452767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 603/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:23.479071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a086a07-9488-4a1c-827b-7521f96e0237 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:23.600881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a086a07-9488-4a1c-827b-7521f96e0237 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:23.640033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb8d0e-ae5b-496d-ba4f-3c89231a6af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:23.640514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8d0e-ae5b-496d-ba4f-3c89231a6af4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:23.640788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8d0e-ae5b-496d-ba4f-3c89231a6af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:23.641065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8d0e-ae5b-496d-ba4f-3c89231a6af4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:23.657343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb8d0e-ae5b-496d-ba4f-3c89231a6af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3fbb8d0e-ae5b-496d-ba4f-3c89231a6af4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:17:23.662756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:23.663856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:23.664755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 605/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:17:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:23.671031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0b42-0a2b-4f17-abdd-9b612a57073c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:23.730197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:23.812451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0b42-0a2b-4f17-abdd-9b612a57073c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:23.856470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319543-9824-45bc-8d52-ce48fb4c6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:23.856997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319543-9824-45bc-8d52-ce48fb4c6989 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:23.857405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319543-9824-45bc-8d52-ce48fb4c6989 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:23.857590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319543-9824-45bc-8d52-ce48fb4c6989 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:23.858448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f319543-9824-45bc-8d52-ce48fb4c6989 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:23.858807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f319543-9824-45bc-8d52-ce48fb4c6989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:23.860317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f319543-9824-45bc-8d52-ce48fb4c6989 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:23.870843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 604/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:17:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:17:23.876889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb8d0e-ae5b-496d-ba4f-3c89231a6af4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:23.936864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:24.034240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb8d0e-ae5b-496d-ba4f-3c89231a6af4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:24.096462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc36490-f60e-49d5-8b12-70f2ccc43e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:24.097619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc36490-f60e-49d5-8b12-70f2ccc43e7e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:24.098101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc36490-f60e-49d5-8b12-70f2ccc43e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:24.098574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc36490-f60e-49d5-8b12-70f2ccc43e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:24.120063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc36490-f60e-49d5-8b12-70f2ccc43e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:24.120851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc36490-f60e-49d5-8b12-70f2ccc43e7e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0cc36490-f60e-49d5-8b12-70f2ccc43e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:24.148962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:24.150147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:24.151881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:24.151881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:24.151881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:24.151881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:24.151881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 606/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:24.159935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319543-9824-45bc-8d52-ce48fb4c6989 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:24.312430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:24.315031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319543-9824-45bc-8d52-ce48fb4c6989 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:24.362206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651a9ee-683d-4686-bf08-3d69d5aca9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:24.362924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651a9ee-683d-4686-bf08-3d69d5aca9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:24.363184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651a9ee-683d-4686-bf08-3d69d5aca9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:24.363386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651a9ee-683d-4686-bf08-3d69d5aca9b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:24.364085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651a9ee-683d-4686-bf08-3d69d5aca9b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:24.364384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651a9ee-683d-4686-bf08-3d69d5aca9b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:24.365844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651a9ee-683d-4686-bf08-3d69d5aca9b9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:24.386398 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 605/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:24.392525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc36490-f60e-49d5-8b12-70f2ccc43e7e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:24.583590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc36490-f60e-49d5-8b12-70f2ccc43e7e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:24.587045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:24.633380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56e9f3-d90c-4831-9ac9-00ec795513b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:24.634494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e9f3-d90c-4831-9ac9-00ec795513b7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:24.634851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e9f3-d90c-4831-9ac9-00ec795513b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:24.635140 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e9f3-d90c-4831-9ac9-00ec795513b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:24.646069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56e9f3-d90c-4831-9ac9-00ec795513b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:24.647765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56e9f3-d90c-4831-9ac9-00ec795513b7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6c56e9f3-d90c-4831-9ac9-00ec795513b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:17:24.662217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:24.669927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:24.671184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 607/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:24.672618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651a9ee-683d-4686-bf08-3d69d5aca9b9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:24.835990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651a9ee-683d-4686-bf08-3d69d5aca9b9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:24.882601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56275926-b252-41f6-a3e6-33d079fd16fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:24.883648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56275926-b252-41f6-a3e6-33d079fd16fc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:24.883981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56275926-b252-41f6-a3e6-33d079fd16fc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:24.884260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56275926-b252-41f6-a3e6-33d079fd16fc None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:24.885184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56275926-b252-41f6-a3e6-33d079fd16fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:24.885586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56275926-b252-41f6-a3e6-33d079fd16fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:24.887218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56275926-b252-41f6-a3e6-33d079fd16fc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:24.913224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 606/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 26 07:17:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:24.919225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56e9f3-d90c-4831-9ac9-00ec795513b7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:25.055192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56e9f3-d90c-4831-9ac9-00ec795513b7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:25.113218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39c09-1ac5-44e4-bb2c-c77256313d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:25.114376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39c09-1ac5-44e4-bb2c-c77256313d57 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:25.114376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39c09-1ac5-44e4-bb2c-c77256313d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:25.114568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39c09-1ac5-44e4-bb2c-c77256313d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:25.156521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:25.205959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d39c09-1ac5-44e4-bb2c-c77256313d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:25.207842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d39c09-1ac5-44e4-bb2c-c77256313d57 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:25.332761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 608/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:17:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:17:25.338838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56275926-b252-41f6-a3e6-33d079fd16fc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:25.361471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:25.464588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56275926-b252-41f6-a3e6-33d079fd16fc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:25.517548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b2302-6c1e-4943-a9ea-39586df5fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:25.519369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b2302-6c1e-4943-a9ea-39586df5fab4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:25.519746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b2302-6c1e-4943-a9ea-39586df5fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:25.520059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b2302-6c1e-4943-a9ea-39586df5fab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:25.535614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b2302-6c1e-4943-a9ea-39586df5fab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:25.537185 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b2302-6c1e-4943-a9ea-39586df5fab4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-fc2b2302-6c1e-4943-a9ea-39586df5fab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:25.560352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:25.562263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:25.564070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:25.564070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:25.564070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:25.564070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:25.564070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 607/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:25.567889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39c09-1ac5-44e4-bb2c-c77256313d57 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:25.646115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:25.700990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39c09-1ac5-44e4-bb2c-c77256313d57 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:25.750117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975bba8-eacd-47cd-82fb-fdbb983ac317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:25.750636 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975bba8-eacd-47cd-82fb-fdbb983ac317 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:25.750917 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975bba8-eacd-47cd-82fb-fdbb983ac317 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:25.751188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975bba8-eacd-47cd-82fb-fdbb983ac317 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:25.751908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975bba8-eacd-47cd-82fb-fdbb983ac317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:25.752207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975bba8-eacd-47cd-82fb-fdbb983ac317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:25.753657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975bba8-eacd-47cd-82fb-fdbb983ac317 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:25.769957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 609/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:25.777790 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b2302-6c1e-4943-a9ea-39586df5fab4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:25.862379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:25.896412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b2302-6c1e-4943-a9ea-39586df5fab4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:25.944827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e113f-1bbf-4ddd-880b-ab2e88bcee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:25.945518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e113f-1bbf-4ddd-880b-ab2e88bcee81 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:25.945801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e113f-1bbf-4ddd-880b-ab2e88bcee81 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:25.946103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e113f-1bbf-4ddd-880b-ab2e88bcee81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:25.954377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e113f-1bbf-4ddd-880b-ab2e88bcee81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:25.955919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e113f-1bbf-4ddd-880b-ab2e88bcee81 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a91e113f-1bbf-4ddd-880b-ab2e88bcee81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:17:25.968462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:25.969810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:25.971270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:17:25.971270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:17:25.971270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:17:25.971270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:17:25.971270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:17:25.971270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:17:25.971270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:25.971270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:25.971270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 608/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:25.975915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975bba8-eacd-47cd-82fb-fdbb983ac317 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:26.089650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975bba8-eacd-47cd-82fb-fdbb983ac317 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:26.114143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:26.126286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451344ee-3f0f-4306-aaf0-a438704135af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:26.126932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451344ee-3f0f-4306-aaf0-a438704135af None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:26.127199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451344ee-3f0f-4306-aaf0-a438704135af None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:26.127471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451344ee-3f0f-4306-aaf0-a438704135af None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:26.128233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451344ee-3f0f-4306-aaf0-a438704135af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:26.128538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451344ee-3f0f-4306-aaf0-a438704135af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:26.130030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451344ee-3f0f-4306-aaf0-a438704135af None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:26.143404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 610/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:17:26.149752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e113f-1bbf-4ddd-880b-ab2e88bcee81 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:26.256418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e113f-1bbf-4ddd-880b-ab2e88bcee81 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:26.287760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:26.294220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738abd54-bc48-45ac-8200-2e94a947ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:26.294854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738abd54-bc48-45ac-8200-2e94a947ba16 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:26.295133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738abd54-bc48-45ac-8200-2e94a947ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:26.295408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738abd54-bc48-45ac-8200-2e94a947ba16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:26.296275 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738abd54-bc48-45ac-8200-2e94a947ba16 None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=826fd481bf2e40d6917bb604591a75cb) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:26.296558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738abd54-bc48-45ac-8200-2e94a947ba16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:26.298042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738abd54-bc48-45ac-8200-2e94a947ba16 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:26.303876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 609/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:17:26 2022] GET /identity/v3/role_assignments?user.id=826fd481bf2e40d6917bb604591a75cb&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:28.387644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d779ec-7415-46c7-ba16-1aae46c2a101 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:28.388505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d779ec-7415-46c7-ba16-1aae46c2a101 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:28.388505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d779ec-7415-46c7-ba16-1aae46c2a101 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:28.389749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 611/1220] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:28.396648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3276262-d93a-4dd7-a818-77db709cdc3e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:28.397168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3276262-d93a-4dd7-a818-77db709cdc3e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:28.397660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3276262-d93a-4dd7-a818-77db709cdc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:28.429424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d3276262-d93a-4dd7-a818-77db709cdc3e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:28.431489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d3276262-d93a-4dd7-a818-77db709cdc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:28.535302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 610/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:28.558397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d779ec-7415-46c7-ba16-1aae46c2a101 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:28.689087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d779ec-7415-46c7-ba16-1aae46c2a101 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:28.730577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9757e-39b3-4209-b7a4-adfb4fb4a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:28.731297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9757e-39b3-4209-b7a4-adfb4fb4a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:28.731610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9757e-39b3-4209-b7a4-adfb4fb4a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:28.731920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9757e-39b3-4209-b7a4-adfb4fb4a3d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:28.744570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9757e-39b3-4209-b7a4-adfb4fb4a3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-88f9757e-39b3-4209-b7a4-adfb4fb4a3d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:17:28.750536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:28.751588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:28.752477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 612/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:17:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:28.758386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3276262-d93a-4dd7-a818-77db709cdc3e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:28.894915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3276262-d93a-4dd7-a818-77db709cdc3e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:28.924848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:28.938244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815fdc7-69cc-4d37-87b9-58c0db7aa4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:28.938918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815fdc7-69cc-4d37-87b9-58c0db7aa4cd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:28.939283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815fdc7-69cc-4d37-87b9-58c0db7aa4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:28.939584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815fdc7-69cc-4d37-87b9-58c0db7aa4cd None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:28.940314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815fdc7-69cc-4d37-87b9-58c0db7aa4cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:28.940618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815fdc7-69cc-4d37-87b9-58c0db7aa4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:28.942160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815fdc7-69cc-4d37-87b9-58c0db7aa4cd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:28.952040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 611/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:17:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:28.958499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9757e-39b3-4209-b7a4-adfb4fb4a3d1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:29.012554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:29.089746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9757e-39b3-4209-b7a4-adfb4fb4a3d1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:29.127905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f172b-7d29-4937-a138-b48cd21d8848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:29.128888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f172b-7d29-4937-a138-b48cd21d8848 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:29.129326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f172b-7d29-4937-a138-b48cd21d8848 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:29.129783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f172b-7d29-4937-a138-b48cd21d8848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:29.145877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f172b-7d29-4937-a138-b48cd21d8848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:29.147403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f172b-7d29-4937-a138-b48cd21d8848 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-681f172b-7d29-4937-a138-b48cd21d8848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:29.163861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:29.165229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:29.166674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:29.166674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:29.166674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:29.166674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:29.166674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 613/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:29.171449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815fdc7-69cc-4d37-87b9-58c0db7aa4cd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:29.287199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815fdc7-69cc-4d37-87b9-58c0db7aa4cd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:29.328423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc90ed9-f421-4f46-baf5-56a278b73838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:29.329382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc90ed9-f421-4f46-baf5-56a278b73838 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:29.329693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc90ed9-f421-4f46-baf5-56a278b73838 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:29.329957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc90ed9-f421-4f46-baf5-56a278b73838 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:29.330773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc90ed9-f421-4f46-baf5-56a278b73838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:29.331063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc90ed9-f421-4f46-baf5-56a278b73838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:29.332489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc90ed9-f421-4f46-baf5-56a278b73838 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:29.346950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 612/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:29.352901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f172b-7d29-4937-a138-b48cd21d8848 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:29.477384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:29.485410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f172b-7d29-4937-a138-b48cd21d8848 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:29.524258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21b29-ac17-4a2d-adc1-d26a5d9922a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:29.524988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21b29-ac17-4a2d-adc1-d26a5d9922a5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:29.525305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21b29-ac17-4a2d-adc1-d26a5d9922a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:29.525616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21b29-ac17-4a2d-adc1-d26a5d9922a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:29.536339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c21b29-ac17-4a2d-adc1-d26a5d9922a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:29.538085 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c21b29-ac17-4a2d-adc1-d26a5d9922a5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f3c21b29-ac17-4a2d-adc1-d26a5d9922a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:17:29.552439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:29.557500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:29.558761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 614/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:29.560818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc90ed9-f421-4f46-baf5-56a278b73838 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:29.612780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:29.680542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc90ed9-f421-4f46-baf5-56a278b73838 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:29.732178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f091b-3010-4da3-9e37-136047bae126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:29.732901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f091b-3010-4da3-9e37-136047bae126 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:29.733208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f091b-3010-4da3-9e37-136047bae126 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:29.733542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f091b-3010-4da3-9e37-136047bae126 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:29.734425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f091b-3010-4da3-9e37-136047bae126 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:29.734740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f091b-3010-4da3-9e37-136047bae126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:29.736249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f091b-3010-4da3-9e37-136047bae126 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:29.756286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 613/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 26 07:17:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:29.763099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21b29-ac17-4a2d-adc1-d26a5d9922a5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:29.895135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21b29-ac17-4a2d-adc1-d26a5d9922a5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:29.935652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b88d-524d-4202-94f1-ce57d38e0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:29.936437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b88d-524d-4202-94f1-ce57d38e0174 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:29.936876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b88d-524d-4202-94f1-ce57d38e0174 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:29.937148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b88d-524d-4202-94f1-ce57d38e0174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:29.949845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6b88d-524d-4202-94f1-ce57d38e0174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:29.952351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6b88d-524d-4202-94f1-ce57d38e0174 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8dc6b88d-524d-4202-94f1-ce57d38e0174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:29.968982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:29.970784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:29.971893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:29.971893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:29.971893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:29.971893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:29.971893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 615/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:17:29.977553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f091b-3010-4da3-9e37-136047bae126 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:30.130850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f091b-3010-4da3-9e37-136047bae126 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:30.135183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:30.188370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbdff6-2d35-4e75-a9d5-a6f181ab5c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:30.189022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbdff6-2d35-4e75-a9d5-a6f181ab5c2d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:30.189358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbdff6-2d35-4e75-a9d5-a6f181ab5c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:30.189733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbdff6-2d35-4e75-a9d5-a6f181ab5c2d None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:30.190465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbdff6-2d35-4e75-a9d5-a6f181ab5c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:30.190857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbdff6-2d35-4e75-a9d5-a6f181ab5c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:30.192341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbdff6-2d35-4e75-a9d5-a6f181ab5c2d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:30.213323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 614/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:30.223393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b88d-524d-4202-94f1-ce57d38e0174 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:30.234909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:30.348869 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b88d-524d-4202-94f1-ce57d38e0174 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:30.408922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa8ae-73ed-4e10-9366-d53af73e6e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:30.409802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa8ae-73ed-4e10-9366-d53af73e6e0a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:30.410123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa8ae-73ed-4e10-9366-d53af73e6e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:30.410483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa8ae-73ed-4e10-9366-d53af73e6e0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:30.420059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fa8ae-73ed-4e10-9366-d53af73e6e0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:30.421645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fa8ae-73ed-4e10-9366-d53af73e6e0a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c68fa8ae-73ed-4e10-9366-d53af73e6e0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:17:30.434451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:30.436027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:30.437508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:17:30.437508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:17:30.437508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:17:30.437508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:17:30.437508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:17:30.437508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:17:30.437508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:30.437508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:30.437508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 616/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:30.443185 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbdff6-2d35-4e75-a9d5-a6f181ab5c2d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:30.571674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbdff6-2d35-4e75-a9d5-a6f181ab5c2d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:30.613489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e035f8-153d-48e6-9024-e3713871ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:30.614139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e035f8-153d-48e6-9024-e3713871ceb7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:30.614452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e035f8-153d-48e6-9024-e3713871ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:30.614756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e035f8-153d-48e6-9024-e3713871ceb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:30.615650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e035f8-153d-48e6-9024-e3713871ceb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:30.615986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e035f8-153d-48e6-9024-e3713871ceb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:30.617681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e035f8-153d-48e6-9024-e3713871ceb7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:30.631989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 615/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:17:30.639492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa8ae-73ed-4e10-9366-d53af73e6e0a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:30.719356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:30.760162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa8ae-73ed-4e10-9366-d53af73e6e0a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:30.801883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8c232-efa4-400e-9218-06d681ca86d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:30.802579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8c232-efa4-400e-9218-06d681ca86d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:30.802862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8c232-efa4-400e-9218-06d681ca86d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:30.803150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8c232-efa4-400e-9218-06d681ca86d3 None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/826fd481bf2e40d6917bb604591a75cb/roles/726231471ff241e9af5bcf89430bd2c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:30.820528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8c232-efa4-400e-9218-06d681ca86d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=826fd481bf2e40d6917bb604591a75cb, role_id=726231471ff241e9af5bcf89430bd2c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:30.822250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8c232-efa4-400e-9218-06d681ca86d3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:30.837393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 617/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:17:30 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/826fd481bf2e40d6917bb604591a75cb/roles/726231471ff241e9af5bcf89430bd2c0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:17:32.915479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe56db8-a208-478e-b89a-22790f19ba36 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:32.916055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe56db8-a208-478e-b89a-22790f19ba36 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:32.916055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe56db8-a208-478e-b89a-22790f19ba36 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:32.917325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 616/1233] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:32.923124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76213dc9-5cc6-49c0-80b7-9d6176f186d0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:32.923644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76213dc9-5cc6-49c0-80b7-9d6176f186d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:32.923644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76213dc9-5cc6-49c0-80b7-9d6176f186d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:32.942997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-76213dc9-5cc6-49c0-80b7-9d6176f186d0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:32.944232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76213dc9-5cc6-49c0-80b7-9d6176f186d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:33.037744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 618/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:33.063037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe56db8-a208-478e-b89a-22790f19ba36 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:33.095917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:33.201986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe56db8-a208-478e-b89a-22790f19ba36 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:33.254583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a623a-ae2b-40a0-9482-8d4d3b05fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:33.255652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a623a-ae2b-40a0-9482-8d4d3b05fe99 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:33.256221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a623a-ae2b-40a0-9482-8d4d3b05fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:33.256553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a623a-ae2b-40a0-9482-8d4d3b05fe99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:33.274471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a623a-ae2b-40a0-9482-8d4d3b05fe99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-501a623a-ae2b-40a0-9482-8d4d3b05fe99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:17:33.280279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:33.282443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:33.283927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 617/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 26 07:17:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:33.293287 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76213dc9-5cc6-49c0-80b7-9d6176f186d0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:33.369871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:33.450966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76213dc9-5cc6-49c0-80b7-9d6176f186d0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:33.509842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a473408-20fd-493c-8f61-fecbe0e0e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:33.510516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a473408-20fd-493c-8f61-fecbe0e0e260 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:33.510796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a473408-20fd-493c-8f61-fecbe0e0e260 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:33.511074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a473408-20fd-493c-8f61-fecbe0e0e260 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:33.511874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a473408-20fd-493c-8f61-fecbe0e0e260 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:33.512163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a473408-20fd-493c-8f61-fecbe0e0e260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:33.513677 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a473408-20fd-493c-8f61-fecbe0e0e260 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:33.523645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 619/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 26 07:17:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:33.529816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a623a-ae2b-40a0-9482-8d4d3b05fe99 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:33.646302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:33.663262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a623a-ae2b-40a0-9482-8d4d3b05fe99 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:33.705307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9f297-fcdf-4a06-a0a7-3a50cf6d471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:33.706035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9f297-fcdf-4a06-a0a7-3a50cf6d471e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:33.706385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9f297-fcdf-4a06-a0a7-3a50cf6d471e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:33.706658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9f297-fcdf-4a06-a0a7-3a50cf6d471e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:33.719022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9f297-fcdf-4a06-a0a7-3a50cf6d471e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:33.720494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9f297-fcdf-4a06-a0a7-3a50cf6d471e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3ea9f297-fcdf-4a06-a0a7-3a50cf6d471e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:33.736083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:33.737205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:33.738222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:33.738222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:33.738222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:33.738222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:33.738222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 618/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:17:33.743800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a473408-20fd-493c-8f61-fecbe0e0e260 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:33.850289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a473408-20fd-493c-8f61-fecbe0e0e260 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:33.861109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:33.892856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e545b-480e-4e5e-8d3a-8e47552cbcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:33.893632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e545b-480e-4e5e-8d3a-8e47552cbcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:33.893913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e545b-480e-4e5e-8d3a-8e47552cbcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:33.894210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e545b-480e-4e5e-8d3a-8e47552cbcd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:33.895000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e545b-480e-4e5e-8d3a-8e47552cbcd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:33.895365 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e545b-480e-4e5e-8d3a-8e47552cbcd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:33.896773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e545b-480e-4e5e-8d3a-8e47552cbcd3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:33.909921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 620/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:33.915838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9f297-fcdf-4a06-a0a7-3a50cf6d471e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:34.035148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9f297-fcdf-4a06-a0a7-3a50cf6d471e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:34.074448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe23df2-39ab-43ff-bd1e-d8518b377551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:34.075209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe23df2-39ab-43ff-bd1e-d8518b377551 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:34.075546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe23df2-39ab-43ff-bd1e-d8518b377551 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:34.075883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe23df2-39ab-43ff-bd1e-d8518b377551 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:34.079144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:34.087101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe23df2-39ab-43ff-bd1e-d8518b377551 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:34.088733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe23df2-39ab-43ff-bd1e-d8518b377551 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-cfe23df2-39ab-43ff-bd1e-d8518b377551 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:17:34.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:34.104456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:34.105633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 619/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:34.109975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e545b-480e-4e5e-8d3a-8e47552cbcd3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:34.247279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e545b-480e-4e5e-8d3a-8e47552cbcd3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:34.293972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8763a-8bbe-478f-ae3c-025ffcbb7739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:34.294623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8763a-8bbe-478f-ae3c-025ffcbb7739 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:34.294910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8763a-8bbe-478f-ae3c-025ffcbb7739 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:34.295197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8763a-8bbe-478f-ae3c-025ffcbb7739 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:34.296214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8763a-8bbe-478f-ae3c-025ffcbb7739 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:34.296510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8763a-8bbe-478f-ae3c-025ffcbb7739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:34.298001 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8763a-8bbe-478f-ae3c-025ffcbb7739 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:34.318792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 621/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 26 07:17:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:34.324855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe23df2-39ab-43ff-bd1e-d8518b377551 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:34.447178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe23df2-39ab-43ff-bd1e-d8518b377551 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:34.483054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e9b0-395a-4e97-b0c1-610da049bfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:34.483736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e9b0-395a-4e97-b0c1-610da049bfff None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:34.484005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e9b0-395a-4e97-b0c1-610da049bfff None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:34.484270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e9b0-395a-4e97-b0c1-610da049bfff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:34.555674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:34.564788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687e9b0-395a-4e97-b0c1-610da049bfff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:34.566412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687e9b0-395a-4e97-b0c1-610da049bfff None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:34.702292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 620/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:17:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:17:34.708076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8763a-8bbe-478f-ae3c-025ffcbb7739 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:34.740162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:34.832529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8763a-8bbe-478f-ae3c-025ffcbb7739 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:34.879032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b82c5-e757-4146-a930-5b624ba62fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:34.879697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b82c5-e757-4146-a930-5b624ba62fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:34.879975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b82c5-e757-4146-a930-5b624ba62fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:34.880245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b82c5-e757-4146-a930-5b624ba62fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:34.891483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b82c5-e757-4146-a930-5b624ba62fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:34.892943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b82c5-e757-4146-a930-5b624ba62fa2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d53b82c5-e757-4146-a930-5b624ba62fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:34.911416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:34.912694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:34.914158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:34.914158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:34.914158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:34.914158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:34.914158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 622/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:17:34.918946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e9b0-395a-4e97-b0c1-610da049bfff None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:35.033472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:35.042663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e9b0-395a-4e97-b0c1-610da049bfff None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:35.086155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd0c39-f512-4466-b678-cec03a480a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:35.086951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd0c39-f512-4466-b678-cec03a480a62 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:35.087233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd0c39-f512-4466-b678-cec03a480a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:35.087510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd0c39-f512-4466-b678-cec03a480a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:35.088432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd0c39-f512-4466-b678-cec03a480a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:35.088839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd0c39-f512-4466-b678-cec03a480a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:35.090838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd0c39-f512-4466-b678-cec03a480a62 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:35.112491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 621/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:35.114270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b82c5-e757-4146-a930-5b624ba62fa2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:35.212557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:35.242136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b82c5-e757-4146-a930-5b624ba62fa2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:35.281600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a265ba-e5b4-42de-be11-6783df584d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:35.282267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a265ba-e5b4-42de-be11-6783df584d8d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:35.282549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a265ba-e5b4-42de-be11-6783df584d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:35.282823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a265ba-e5b4-42de-be11-6783df584d8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:35.290681 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a265ba-e5b4-42de-be11-6783df584d8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:35.292251 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a265ba-e5b4-42de-be11-6783df584d8d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d6a265ba-e5b4-42de-be11-6783df584d8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:17:35.305152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:35.306350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:35.307290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:17:35.307290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:17:35.307290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:17:35.307290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:17:35.307290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:17:35.307290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:17:35.307290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:35.307290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:35.307290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 623/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:17:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:35.313051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd0c39-f512-4466-b678-cec03a480a62 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:35.431643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd0c39-f512-4466-b678-cec03a480a62 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:35.471467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ba62-33da-4659-8b34-5b04112f58a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:35.472154 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ba62-33da-4659-8b34-5b04112f58a1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:35.472435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ba62-33da-4659-8b34-5b04112f58a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:35.472709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ba62-33da-4659-8b34-5b04112f58a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:35.473537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ba62-33da-4659-8b34-5b04112f58a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:35.473847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ba62-33da-4659-8b34-5b04112f58a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:35.475479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ba62-33da-4659-8b34-5b04112f58a1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:35.491372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 622/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:35.498860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a265ba-e5b4-42de-be11-6783df584d8d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:35.647241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a265ba-e5b4-42de-be11-6783df584d8d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:35.688604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c91dbb-1286-4216-b248-1f14ece5ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:35.689446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c91dbb-1286-4216-b248-1f14ece5ab1f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:35.689764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c91dbb-1286-4216-b248-1f14ece5ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:35.690037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c91dbb-1286-4216-b248-1f14ece5ab1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:35.690913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c91dbb-1286-4216-b248-1f14ece5ab1f None admin] RBAC: Adding query filter params (role.id=726231471ff241e9af5bcf89430bd2c0, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=826fd481bf2e40d6917bb604591a75cb) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:35.691304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c91dbb-1286-4216-b248-1f14ece5ab1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:35.692911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c91dbb-1286-4216-b248-1f14ece5ab1f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:35.702988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 624/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:17:35 2022] GET /identity/v3/role_assignments?user.id=826fd481bf2e40d6917bb604591a75cb&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=726231471ff241e9af5bcf89430bd2c0 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:38.019013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e6e51-a11d-4888-a4de-c33881e47669 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:38.019763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e6e51-a11d-4888-a4de-c33881e47669 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:38.019763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e6e51-a11d-4888-a4de-c33881e47669 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:38.021413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 623/1247] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:38.029775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e528a-7fdd-48ee-a065-8c313a9e409f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:38.029775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e528a-7fdd-48ee-a065-8c313a9e409f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:38.029775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e528a-7fdd-48ee-a065-8c313a9e409f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:38.039255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:38.054077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ca7e528a-7fdd-48ee-a065-8c313a9e409f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:38.055488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ca7e528a-7fdd-48ee-a065-8c313a9e409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:38.148384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 625/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:38.174827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e6e51-a11d-4888-a4de-c33881e47669 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:38.201423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:38.317724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e6e51-a11d-4888-a4de-c33881e47669 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:38.367716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f18866-2bb6-4a3e-9f22-15d93ea9c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:38.368738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f18866-2bb6-4a3e-9f22-15d93ea9c67a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:38.369094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f18866-2bb6-4a3e-9f22-15d93ea9c67a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:38.369544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f18866-2bb6-4a3e-9f22-15d93ea9c67a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:38.385306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f18866-2bb6-4a3e-9f22-15d93ea9c67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-98f18866-2bb6-4a3e-9f22-15d93ea9c67a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:17:38.395293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:38.396554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:38.403387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 624/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:17:38.404701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e528a-7fdd-48ee-a065-8c313a9e409f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:38.560495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e528a-7fdd-48ee-a065-8c313a9e409f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:38.609300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:38.615404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c840324-ce55-4ec3-9702-4a2805f405d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:38.616159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c840324-ce55-4ec3-9702-4a2805f405d8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:38.616414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c840324-ce55-4ec3-9702-4a2805f405d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:38.616682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c840324-ce55-4ec3-9702-4a2805f405d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:38.617542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c840324-ce55-4ec3-9702-4a2805f405d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:38.617848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c840324-ce55-4ec3-9702-4a2805f405d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:38.619321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c840324-ce55-4ec3-9702-4a2805f405d8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:38.630009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 626/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:38.636841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f18866-2bb6-4a3e-9f22-15d93ea9c67a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:38.748129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:38.775542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f18866-2bb6-4a3e-9f22-15d93ea9c67a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:38.822325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7c052-7af4-4e0b-8685-f0be4fc4da8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:38.823014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7c052-7af4-4e0b-8685-f0be4fc4da8a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:38.823370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7c052-7af4-4e0b-8685-f0be4fc4da8a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:38.823742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7c052-7af4-4e0b-8685-f0be4fc4da8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:38.840371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7c052-7af4-4e0b-8685-f0be4fc4da8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:38.841992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7c052-7af4-4e0b-8685-f0be4fc4da8a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a3c7c052-7af4-4e0b-8685-f0be4fc4da8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:38.859476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:38.860546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:38.861716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:38.861716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:38.861716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:38.861716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:38.861716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 625/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:17:38.866814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c840324-ce55-4ec3-9702-4a2805f405d8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:38.991659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c840324-ce55-4ec3-9702-4a2805f405d8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:39.036616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc5b43-0fae-4525-903e-089463ac6122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:39.037378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5b43-0fae-4525-903e-089463ac6122 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:39.037669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5b43-0fae-4525-903e-089463ac6122 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:39.037892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5b43-0fae-4525-903e-089463ac6122 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:39.038552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc5b43-0fae-4525-903e-089463ac6122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:39.038862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc5b43-0fae-4525-903e-089463ac6122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:39.040342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc5b43-0fae-4525-903e-089463ac6122 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:39.056562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 627/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:39.062573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7c052-7af4-4e0b-8685-f0be4fc4da8a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:39.186297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7c052-7af4-4e0b-8685-f0be4fc4da8a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:39.221303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:39.232746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea4500-5dff-4a21-ba5e-3cdb022bc5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:39.233614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea4500-5dff-4a21-ba5e-3cdb022bc5ff None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:39.233983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea4500-5dff-4a21-ba5e-3cdb022bc5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:39.234208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea4500-5dff-4a21-ba5e-3cdb022bc5ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:39.243459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea4500-5dff-4a21-ba5e-3cdb022bc5ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:39.245010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea4500-5dff-4a21-ba5e-3cdb022bc5ff None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2eea4500-5dff-4a21-ba5e-3cdb022bc5ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:17:39.260657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:39.266999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:39.268265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 626/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:17:39.268993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc5b43-0fae-4525-903e-089463ac6122 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:39.338266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:39.388991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc5b43-0fae-4525-903e-089463ac6122 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:39.429601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc89cc-068e-4f6b-b504-eabafe282223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:39.430299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc89cc-068e-4f6b-b504-eabafe282223 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:39.430653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc89cc-068e-4f6b-b504-eabafe282223 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:39.430900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc89cc-068e-4f6b-b504-eabafe282223 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:39.431831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc89cc-068e-4f6b-b504-eabafe282223 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:39.432166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc89cc-068e-4f6b-b504-eabafe282223 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:39.433735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc89cc-068e-4f6b-b504-eabafe282223 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:39.454901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 628/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 26 07:17:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:39.461664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea4500-5dff-4a21-ba5e-3cdb022bc5ff None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:39.586199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea4500-5dff-4a21-ba5e-3cdb022bc5ff None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:39.636220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350c10d-2495-490d-90fd-4b441582b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:39.636220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350c10d-2495-490d-90fd-4b441582b35b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:39.636534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350c10d-2495-490d-90fd-4b441582b35b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:39.636676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350c10d-2495-490d-90fd-4b441582b35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:39.715264 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:39.731947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350c10d-2495-490d-90fd-4b441582b35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:39.733514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350c10d-2495-490d-90fd-4b441582b35b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:39.862793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 627/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:17:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:17:39.869707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc89cc-068e-4f6b-b504-eabafe282223 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:39.997425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc89cc-068e-4f6b-b504-eabafe282223 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:40.019770 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:40.050148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863807-961e-437c-a94c-2f46adc5810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:40.050920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863807-961e-437c-a94c-2f46adc5810b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:40.051241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863807-961e-437c-a94c-2f46adc5810b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:40.051645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863807-961e-437c-a94c-2f46adc5810b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:40.065860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863807-961e-437c-a94c-2f46adc5810b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:40.067611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863807-961e-437c-a94c-2f46adc5810b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-84863807-961e-437c-a94c-2f46adc5810b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:40.085195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:40.086426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:40.087533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:40.087533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:40.087533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:40.087533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:40.087533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 629/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:40.093232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350c10d-2495-490d-90fd-4b441582b35b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:40.202038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:40.219338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350c10d-2495-490d-90fd-4b441582b35b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:40.265498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029cc77-0316-4501-8abe-8ce921163941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:40.266147 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029cc77-0316-4501-8abe-8ce921163941 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:40.266426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029cc77-0316-4501-8abe-8ce921163941 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:40.266701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029cc77-0316-4501-8abe-8ce921163941 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:40.267416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029cc77-0316-4501-8abe-8ce921163941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:40.267809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029cc77-0316-4501-8abe-8ce921163941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:40.269477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029cc77-0316-4501-8abe-8ce921163941 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:40.283528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 628/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:40.290451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863807-961e-437c-a94c-2f46adc5810b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:40.422077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863807-961e-437c-a94c-2f46adc5810b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:40.474647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba786bd-fa6f-4f8b-8ffe-d139aada378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:40.475325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba786bd-fa6f-4f8b-8ffe-d139aada378c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:40.475632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba786bd-fa6f-4f8b-8ffe-d139aada378c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:40.475881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba786bd-fa6f-4f8b-8ffe-d139aada378c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:40.485787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba786bd-fa6f-4f8b-8ffe-d139aada378c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:40.487567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba786bd-fa6f-4f8b-8ffe-d139aada378c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-dba786bd-fa6f-4f8b-8ffe-d139aada378c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:17:40.504905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:40.506238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:40.507477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:17:40.507477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:17:40.507477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:17:40.507477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:17:40.507477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:17:40.507477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:17:40.507477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:40.507477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:40.511228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 630/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:40.512408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029cc77-0316-4501-8abe-8ce921163941 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:40.636453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029cc77-0316-4501-8abe-8ce921163941 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:40.678664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433d295-49e2-42a3-bb9f-c47d78679faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:40.679357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433d295-49e2-42a3-bb9f-c47d78679faa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:40.679616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433d295-49e2-42a3-bb9f-c47d78679faa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:40.679929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433d295-49e2-42a3-bb9f-c47d78679faa None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:40.680724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433d295-49e2-42a3-bb9f-c47d78679faa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:40.681033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433d295-49e2-42a3-bb9f-c47d78679faa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:40.682511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433d295-49e2-42a3-bb9f-c47d78679faa None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:40.697339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 629/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:17:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:40.704428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba786bd-fa6f-4f8b-8ffe-d139aada378c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:40.743503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:40.838796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba786bd-fa6f-4f8b-8ffe-d139aada378c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:40.884832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c9d0b-be5e-43e0-aed1-8051c8f7f457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:40.885443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c9d0b-be5e-43e0-aed1-8051c8f7f457 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:40.885723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c9d0b-be5e-43e0-aed1-8051c8f7f457 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:40.885994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c9d0b-be5e-43e0-aed1-8051c8f7f457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:40.886809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c9d0b-be5e-43e0-aed1-8051c8f7f457 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=826fd481bf2e40d6917bb604591a75cb) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:40.887116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c9d0b-be5e-43e0-aed1-8051c8f7f457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:40.888587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c9d0b-be5e-43e0-aed1-8051c8f7f457 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:40.895656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 631/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:17:40 2022] GET /identity/v3/role_assignments?user.id=826fd481bf2e40d6917bb604591a75cb&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:43.040375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d801-8fb0-4978-9cbb-2e653b4b4981 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:43.040955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d801-8fb0-4978-9cbb-2e653b4b4981 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:43.040955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d801-8fb0-4978-9cbb-2e653b4b4981 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:43.042375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 630/1261] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:43.048048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf336ec6-f2ee-49b8-bbfa-f37ac98608a0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:43.048483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf336ec6-f2ee-49b8-bbfa-f37ac98608a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:43.048584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf336ec6-f2ee-49b8-bbfa-f37ac98608a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:43.067964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cf336ec6-f2ee-49b8-bbfa-f37ac98608a0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:43.069179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cf336ec6-f2ee-49b8-bbfa-f37ac98608a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:43.139793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 632/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:43.163228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d801-8fb0-4978-9cbb-2e653b4b4981 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:43.174983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:43.272970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d801-8fb0-4978-9cbb-2e653b4b4981 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:43.311426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd089725-6dd2-4c9e-b7d7-8775cc5e922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:43.312028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd089725-6dd2-4c9e-b7d7-8775cc5e922b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:43.312311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd089725-6dd2-4c9e-b7d7-8775cc5e922b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:43.312587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd089725-6dd2-4c9e-b7d7-8775cc5e922b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:43.323940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd089725-6dd2-4c9e-b7d7-8775cc5e922b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-fd089725-6dd2-4c9e-b7d7-8775cc5e922b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:17:43.329018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:43.330748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:43.332074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 631/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:17:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:43.336829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf336ec6-f2ee-49b8-bbfa-f37ac98608a0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:43.356210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:43.439718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf336ec6-f2ee-49b8-bbfa-f37ac98608a0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:43.478574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824bec0-623e-4a02-920d-588a23628162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:43.479189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824bec0-623e-4a02-920d-588a23628162 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:43.479467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824bec0-623e-4a02-920d-588a23628162 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:43.479743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824bec0-623e-4a02-920d-588a23628162 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:43.480480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824bec0-623e-4a02-920d-588a23628162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:43.480785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824bec0-623e-4a02-920d-588a23628162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:43.482210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824bec0-623e-4a02-920d-588a23628162 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:43.491391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 633/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:17:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:43.497770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd089725-6dd2-4c9e-b7d7-8775cc5e922b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:43.572667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:43.607858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd089725-6dd2-4c9e-b7d7-8775cc5e922b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:43.644121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aefabd-5354-4ac3-8312-217b873816b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:43.644773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aefabd-5354-4ac3-8312-217b873816b0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:43.645048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aefabd-5354-4ac3-8312-217b873816b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:43.645332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aefabd-5354-4ac3-8312-217b873816b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:43.656478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aefabd-5354-4ac3-8312-217b873816b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:43.657959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aefabd-5354-4ac3-8312-217b873816b0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-29aefabd-5354-4ac3-8312-217b873816b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:43.674619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:43.675793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:43.677024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:43.677024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:43.677024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:43.677024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:43.677024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 632/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:43.682557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824bec0-623e-4a02-920d-588a23628162 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:43.772143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:43.796984 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824bec0-623e-4a02-920d-588a23628162 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:43.834013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887817c-820c-4ce1-b622-b6525114226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:43.834920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887817c-820c-4ce1-b622-b6525114226e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:43.835385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887817c-820c-4ce1-b622-b6525114226e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:43.835718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887817c-820c-4ce1-b622-b6525114226e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:43.836651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887817c-820c-4ce1-b622-b6525114226e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:43.837140 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887817c-820c-4ce1-b622-b6525114226e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:43.839937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887817c-820c-4ce1-b622-b6525114226e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:43.857016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 634/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:43.863372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aefabd-5354-4ac3-8312-217b873816b0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:43.976473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aefabd-5354-4ac3-8312-217b873816b0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:44.000578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:44.019130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4a27-fba7-40c8-bcca-3213281db063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:44.019805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4a27-fba7-40c8-bcca-3213281db063 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:44.020087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4a27-fba7-40c8-bcca-3213281db063 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:44.020387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4a27-fba7-40c8-bcca-3213281db063 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:44.029646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f4a27-fba7-40c8-bcca-3213281db063 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:44.031210 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f4a27-fba7-40c8-bcca-3213281db063 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9b7f4a27-fba7-40c8-bcca-3213281db063 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:17:44.046783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:44.048505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:44.049746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 633/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:44.054225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887817c-820c-4ce1-b622-b6525114226e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:44.169367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887817c-820c-4ce1-b622-b6525114226e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:44.216549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fd4e4-87b5-4c83-83be-027127364ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:44.217181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fd4e4-87b5-4c83-83be-027127364ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:44.217480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fd4e4-87b5-4c83-83be-027127364ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:44.217789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fd4e4-87b5-4c83-83be-027127364ee4 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:44.218600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fd4e4-87b5-4c83-83be-027127364ee4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:44.218906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fd4e4-87b5-4c83-83be-027127364ee4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:44.220418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fd4e4-87b5-4c83-83be-027127364ee4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:44.230409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:44.240442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 635/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 26 07:17:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:44.246773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4a27-fba7-40c8-bcca-3213281db063 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:44.353700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4a27-fba7-40c8-bcca-3213281db063 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:44.388207 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95affd-3c60-43de-9d0b-1eb4bf9f9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:44.388895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95affd-3c60-43de-9d0b-1eb4bf9f9dfe None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:44.389161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95affd-3c60-43de-9d0b-1eb4bf9f9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:44.389517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95affd-3c60-43de-9d0b-1eb4bf9f9dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:44.401370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95affd-3c60-43de-9d0b-1eb4bf9f9dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:44.402838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95affd-3c60-43de-9d0b-1eb4bf9f9dfe None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3d95affd-3c60-43de-9d0b-1eb4bf9f9dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:44.417535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:44.418707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:44.420040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:44.420040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:44.420040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:44.420040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:44.420040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 634/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:44.424871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fd4e4-87b5-4c83-83be-027127364ee4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:44.533831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fd4e4-87b5-4c83-83be-027127364ee4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:44.570392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5e242-b9f3-4a8c-a2e4-8ef27a655e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:44.571022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5e242-b9f3-4a8c-a2e4-8ef27a655e1e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:44.571297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5e242-b9f3-4a8c-a2e4-8ef27a655e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:44.571565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5e242-b9f3-4a8c-a2e4-8ef27a655e1e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:44.572267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5e242-b9f3-4a8c-a2e4-8ef27a655e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:44.572566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5e242-b9f3-4a8c-a2e4-8ef27a655e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:44.573978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5e242-b9f3-4a8c-a2e4-8ef27a655e1e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:44.585712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 636/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:44.591991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95affd-3c60-43de-9d0b-1eb4bf9f9dfe None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:44.626940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:44.703819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95affd-3c60-43de-9d0b-1eb4bf9f9dfe None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:44.742065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3265c-8b23-4ada-a5c4-e0f7e9f3e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:44.742725 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3265c-8b23-4ada-a5c4-e0f7e9f3e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:44.743008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3265c-8b23-4ada-a5c4-e0f7e9f3e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:44.743283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3265c-8b23-4ada-a5c4-e0f7e9f3e7d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:44.752727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3265c-8b23-4ada-a5c4-e0f7e9f3e7d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:44.754244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3265c-8b23-4ada-a5c4-e0f7e9f3e7d1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e4b3265c-8b23-4ada-a5c4-e0f7e9f3e7d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:17:44.766753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:44.767999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:44.769135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:17:44.769135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:17:44.769135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:17:44.769135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:17:44.769135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:17:44.769135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:17:44.769135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:44.769135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:44.769135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 635/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:44.775958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5e242-b9f3-4a8c-a2e4-8ef27a655e1e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:44.836701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:44.881905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5e242-b9f3-4a8c-a2e4-8ef27a655e1e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:44.916892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcf1c6-4333-4027-bcd7-68b60b04d737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:44.917561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf1c6-4333-4027-bcd7-68b60b04d737 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:44.917841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf1c6-4333-4027-bcd7-68b60b04d737 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:44.918113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf1c6-4333-4027-bcd7-68b60b04d737 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:44.918894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcf1c6-4333-4027-bcd7-68b60b04d737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:44.919189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcf1c6-4333-4027-bcd7-68b60b04d737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:44.920651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcf1c6-4333-4027-bcd7-68b60b04d737 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:44.933389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 637/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:17:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:44.939759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3265c-8b23-4ada-a5c4-e0f7e9f3e7d1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:45.050687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:45.060906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3265c-8b23-4ada-a5c4-e0f7e9f3e7d1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:45.099339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edf959-6b71-4c43-b491-e047cf10679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:45.100026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edf959-6b71-4c43-b491-e047cf10679a None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:45.100306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edf959-6b71-4c43-b491-e047cf10679a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:45.100585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edf959-6b71-4c43-b491-e047cf10679a None admin] PATH_INFO: `/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/826fd481bf2e40d6917bb604591a75cb/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:45.102634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edf959-6b71-4c43-b491-e047cf10679a None admin] RBAC: Authorizing `identity:create_grant(project_id=6564e74c0f8945f1a29a3ffc15482594, user_id=826fd481bf2e40d6917bb604591a75cb, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:45.104083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edf959-6b71-4c43-b491-e047cf10679a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:45.119191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 636/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 26 07:17:44 2022] PUT /identity/v3/projects/6564e74c0f8945f1a29a3ffc15482594/users/826fd481bf2e40d6917bb604591a75cb/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:17:47.145215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fff4-3370-480c-9b92-d467a8726285 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:47.145904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fff4-3370-480c-9b92-d467a8726285 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:47.145904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fff4-3370-480c-9b92-d467a8726285 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:47.147323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 638/1274] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:47.153435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635697c-d858-45d7-be71-f24fff50ed05 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:47.153993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635697c-d858-45d7-be71-f24fff50ed05 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:47.153993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635697c-d858-45d7-be71-f24fff50ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:47.174722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e635697c-d858-45d7-be71-f24fff50ed05 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:47.175963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e635697c-d858-45d7-be71-f24fff50ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:47.251690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 637/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:47.279166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893fff4-3370-480c-9b92-d467a8726285 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:47.391946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893fff4-3370-480c-9b92-d467a8726285 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:47.411053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:47.431009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2adc6-3239-45fc-a902-dc9aa70336ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:47.431678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2adc6-3239-45fc-a902-dc9aa70336ef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:47.431938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2adc6-3239-45fc-a902-dc9aa70336ef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:47.432211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2adc6-3239-45fc-a902-dc9aa70336ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:47.443427 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2adc6-3239-45fc-a902-dc9aa70336ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3ef2adc6-3239-45fc-a902-dc9aa70336ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:17:47.448453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:47.450094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:47.451114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 639/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 26 07:17:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:47.456305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635697c-d858-45d7-be71-f24fff50ed05 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:47.549709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:47.572871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635697c-d858-45d7-be71-f24fff50ed05 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:47.609877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7378e-916e-45cf-9848-bedd278f0800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:47.610516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7378e-916e-45cf-9848-bedd278f0800 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:47.610822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7378e-916e-45cf-9848-bedd278f0800 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:47.611088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7378e-916e-45cf-9848-bedd278f0800 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:47.611819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7378e-916e-45cf-9848-bedd278f0800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:47.612119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7378e-916e-45cf-9848-bedd278f0800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:47.613538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7378e-916e-45cf-9848-bedd278f0800 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:47.623149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 638/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 26 07:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:17:47.629367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2adc6-3239-45fc-a902-dc9aa70336ef None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:47.742585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2adc6-3239-45fc-a902-dc9aa70336ef None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:47.779552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a57c6-d75d-4045-9946-7d11292c23f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:47.780278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a57c6-d75d-4045-9946-7d11292c23f0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:47.780559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a57c6-d75d-4045-9946-7d11292c23f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:47.780832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a57c6-d75d-4045-9946-7d11292c23f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:47.792841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a57c6-d75d-4045-9946-7d11292c23f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:47.794366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a57c6-d75d-4045-9946-7d11292c23f0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d20a57c6-d75d-4045-9946-7d11292c23f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:47.810059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:47.811741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:47.813557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:47.813557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:47.813557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:47.813557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:47.813557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 640/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:47.818577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7378e-916e-45cf-9848-bedd278f0800 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:47.928200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7378e-916e-45cf-9848-bedd278f0800 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:47.965706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a69caa-6c81-4a32-8488-8941cc3d6c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:47.966457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a69caa-6c81-4a32-8488-8941cc3d6c31 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:47.966787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a69caa-6c81-4a32-8488-8941cc3d6c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:47.967106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a69caa-6c81-4a32-8488-8941cc3d6c31 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:47.967949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a69caa-6c81-4a32-8488-8941cc3d6c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:47.968309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a69caa-6c81-4a32-8488-8941cc3d6c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:47.969792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a69caa-6c81-4a32-8488-8941cc3d6c31 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:47.983448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 639/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:47.990915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a57c6-d75d-4045-9946-7d11292c23f0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:48.037868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:48.134399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a57c6-d75d-4045-9946-7d11292c23f0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:48.193097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168706-61e3-4b6b-a986-dae553dc2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:48.193833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168706-61e3-4b6b-a986-dae553dc2559 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:48.194014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168706-61e3-4b6b-a986-dae553dc2559 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:48.194309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168706-61e3-4b6b-a986-dae553dc2559 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:48.203896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21168706-61e3-4b6b-a986-dae553dc2559 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:48.205481 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21168706-61e3-4b6b-a986-dae553dc2559 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-21168706-61e3-4b6b-a986-dae553dc2559 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:17:48.218692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:48.219985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:48.221159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 641/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:48.226676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a69caa-6c81-4a32-8488-8941cc3d6c31 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:48.231192 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:48.336133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a69caa-6c81-4a32-8488-8941cc3d6c31 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:48.373748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b46c84-f6f5-43d9-a4a4-af1ad3a2bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:48.374388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b46c84-f6f5-43d9-a4a4-af1ad3a2bb36 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:48.374661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b46c84-f6f5-43d9-a4a4-af1ad3a2bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:48.374928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b46c84-f6f5-43d9-a4a4-af1ad3a2bb36 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:48.375746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b46c84-f6f5-43d9-a4a4-af1ad3a2bb36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:48.376055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b46c84-f6f5-43d9-a4a4-af1ad3a2bb36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:48.377545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b46c84-f6f5-43d9-a4a4-af1ad3a2bb36 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:48.397333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 640/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 26 07:17:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:48.404076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168706-61e3-4b6b-a986-dae553dc2559 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:48.568207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:48.583902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168706-61e3-4b6b-a986-dae553dc2559 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:48.646975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddfe45-16ba-4fd5-b0aa-d72efeea86a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:48.647985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddfe45-16ba-4fd5-b0aa-d72efeea86a0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:48.648422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddfe45-16ba-4fd5-b0aa-d72efeea86a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:48.648857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddfe45-16ba-4fd5-b0aa-d72efeea86a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:48.733948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddfe45-16ba-4fd5-b0aa-d72efeea86a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:48.735481 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddfe45-16ba-4fd5-b0aa-d72efeea86a0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:48.831894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:48.844799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 642/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 26 07:17:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:17:48.851202 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b46c84-f6f5-43d9-a4a4-af1ad3a2bb36 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:48.917916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:48.959170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b46c84-f6f5-43d9-a4a4-af1ad3a2bb36 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:49.000917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4dc5-a201-486e-86c6-ee3cc0d93522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:49.002062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4dc5-a201-486e-86c6-ee3cc0d93522 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:49.002566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4dc5-a201-486e-86c6-ee3cc0d93522 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:49.003058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4dc5-a201-486e-86c6-ee3cc0d93522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:49.017313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d4dc5-a201-486e-86c6-ee3cc0d93522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:49.018795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d4dc5-a201-486e-86c6-ee3cc0d93522 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8c9d4dc5-a201-486e-86c6-ee3cc0d93522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:17:49.035667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:49.037396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:49.038465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:17:49.038465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:17:49.038465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:17:49.038465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:49.038465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 641/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:49.043045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddfe45-16ba-4fd5-b0aa-d72efeea86a0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:49.181945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddfe45-16ba-4fd5-b0aa-d72efeea86a0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:49.241494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3955bf-43b3-4b3f-9105-a3a168177eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:49.242461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3955bf-43b3-4b3f-9105-a3a168177eff None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:49.242912 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3955bf-43b3-4b3f-9105-a3a168177eff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:49.243392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3955bf-43b3-4b3f-9105-a3a168177eff None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:49.244526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3955bf-43b3-4b3f-9105-a3a168177eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:49.245024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3955bf-43b3-4b3f-9105-a3a168177eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:49.247556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3955bf-43b3-4b3f-9105-a3a168177eff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:49.268380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 643/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 26 07:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:49.274454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4dc5-a201-486e-86c6-ee3cc0d93522 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:49.381400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4dc5-a201-486e-86c6-ee3cc0d93522 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:49.396290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:49.419453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1e41c-2d48-49a9-a83c-38f86ccfc473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:49.420116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1e41c-2d48-49a9-a83c-38f86ccfc473 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:49.420392 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1e41c-2d48-49a9-a83c-38f86ccfc473 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:49.420710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1e41c-2d48-49a9-a83c-38f86ccfc473 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:49.428307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1e41c-2d48-49a9-a83c-38f86ccfc473 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:49.429833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1e41c-2d48-49a9-a83c-38f86ccfc473 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-86a1e41c-2d48-49a9-a83c-38f86ccfc473 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:17:49.442856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:49.444208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:49.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:17:49.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:17:49.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:17:49.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:17:49.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:17:49.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:17:49.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:17:49.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 26 07:17:49.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 642/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 26 07:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:49.451675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3955bf-43b3-4b3f-9105-a3a168177eff None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:49.511973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:49.569762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3955bf-43b3-4b3f-9105-a3a168177eff None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:49.607811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4bf32-7e50-472f-b7a8-63487e94958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:49.608507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bf32-7e50-472f-b7a8-63487e94958d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:49.608787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bf32-7e50-472f-b7a8-63487e94958d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:49.609046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bf32-7e50-472f-b7a8-63487e94958d None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:49.609982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4bf32-7e50-472f-b7a8-63487e94958d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:49.610296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4bf32-7e50-472f-b7a8-63487e94958d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:49.611765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4bf32-7e50-472f-b7a8-63487e94958d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:49.625161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 644/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 26 07:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:49.631812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1e41c-2d48-49a9-a83c-38f86ccfc473 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:49.746398 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1e41c-2d48-49a9-a83c-38f86ccfc473 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:49.783184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76150b78-8f4d-45f5-990a-eaa7b0d946d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:49.783902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76150b78-8f4d-45f5-990a-eaa7b0d946d9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:49.784235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76150b78-8f4d-45f5-990a-eaa7b0d946d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:49.784557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76150b78-8f4d-45f5-990a-eaa7b0d946d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:49.785474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76150b78-8f4d-45f5-990a-eaa7b0d946d9 None admin] RBAC: Adding query filter params (role.id=d26c3014383f407e8d13f5a0ac4f7d8a, scope.project.id=6564e74c0f8945f1a29a3ffc15482594, user.id=826fd481bf2e40d6917bb604591a75cb) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:49.785846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76150b78-8f4d-45f5-990a-eaa7b0d946d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:49.787354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76150b78-8f4d-45f5-990a-eaa7b0d946d9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:49.793953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 643/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 26 07:17:49 2022] GET /identity/v3/role_assignments?user.id=826fd481bf2e40d6917bb604591a75cb&scope.project.id=6564e74c0f8945f1a29a3ffc15482594&role.id=d26c3014383f407e8d13f5a0ac4f7d8a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:17:51.903327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afbf1b-0e2b-4b92-adb5-94777bd4f50b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:51.903875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afbf1b-0e2b-4b92-adb5-94777bd4f50b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:51.903875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afbf1b-0e2b-4b92-adb5-94777bd4f50b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:51.905203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 645/1288] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:51.910992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63146e41-bbfc-4c2f-8718-acc67dfef054 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:51.911494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63146e41-bbfc-4c2f-8718-acc67dfef054 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:51.911623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63146e41-bbfc-4c2f-8718-acc67dfef054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:51.930716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-63146e41-bbfc-4c2f-8718-acc67dfef054 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:51.931944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-63146e41-bbfc-4c2f-8718-acc67dfef054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:51.962767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:52.007615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 644/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:52.034462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afbf1b-0e2b-4b92-adb5-94777bd4f50b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:52.149233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afbf1b-0e2b-4b92-adb5-94777bd4f50b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:52.162530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:52.189726 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de01083-4754-41e4-9e63-e97a5f3e7da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:52.190398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de01083-4754-41e4-9e63-e97a5f3e7da5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:52.190649 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de01083-4754-41e4-9e63-e97a5f3e7da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:52.190951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de01083-4754-41e4-9e63-e97a5f3e7da5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:52.191595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de01083-4754-41e4-9e63-e97a5f3e7da5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:52.192973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de01083-4754-41e4-9e63-e97a5f3e7da5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2de01083-4754-41e4-9e63-e97a5f3e7da5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:52.202925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:52.204338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:17:52.205496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:52.209568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 646/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:17:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:52.211013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63146e41-bbfc-4c2f-8718-acc67dfef054 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:52.335061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63146e41-bbfc-4c2f-8718-acc67dfef054 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:52.372567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8cfd-8d62-4621-bad0-f81333f7d127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:52.373213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8cfd-8d62-4621-bad0-f81333f7d127 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:52.373524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8cfd-8d62-4621-bad0-f81333f7d127 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:52.373851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8cfd-8d62-4621-bad0-f81333f7d127 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:52.374564 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8cfd-8d62-4621-bad0-f81333f7d127 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:52.374853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8cfd-8d62-4621-bad0-f81333f7d127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:52.376258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8cfd-8d62-4621-bad0-f81333f7d127 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:52.381644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 645/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 26 07:17:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:52.387881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de01083-4754-41e4-9e63-e97a5f3e7da5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:52.495845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de01083-4754-41e4-9e63-e97a5f3e7da5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:52.531350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f09239-a10a-4083-a14c-84b63c720fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:52.531973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f09239-a10a-4083-a14c-84b63c720fce None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:52.532244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f09239-a10a-4083-a14c-84b63c720fce None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:52.532513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f09239-a10a-4083-a14c-84b63c720fce None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:52.533190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f09239-a10a-4083-a14c-84b63c720fce None admin] RBAC: Adding query filter params (type=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:52.533520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f09239-a10a-4083-a14c-84b63c720fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:52.534879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f09239-a10a-4083-a14c-84b63c720fce None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:52.539533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 647/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 26 07:17:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:54.521899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1a95-6be1-4cdc-9f36-e693faa861dc None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:54.522476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1a95-6be1-4cdc-9f36-e693faa861dc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:54.522476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1a95-6be1-4cdc-9f36-e693faa861dc None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:54.524369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 646/1293] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:54.530906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0becb23-619f-436b-979d-8af86ad964db None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:54.530906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0becb23-619f-436b-979d-8af86ad964db None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:54.530906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0becb23-619f-436b-979d-8af86ad964db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:54.549903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e0becb23-619f-436b-979d-8af86ad964db None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:54.551109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e0becb23-619f-436b-979d-8af86ad964db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:54.582302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:54.624046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 648/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:54.647844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae1a95-6be1-4cdc-9f36-e693faa861dc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:54.686408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:54.765466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae1a95-6be1-4cdc-9f36-e693faa861dc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:54.804481 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6293e-881f-400a-9f67-9957427f5c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:54.805019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6293e-881f-400a-9f67-9957427f5c32 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:54.805300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6293e-881f-400a-9f67-9957427f5c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:54.805590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6293e-881f-400a-9f67-9957427f5c32 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:54.806311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6293e-881f-400a-9f67-9957427f5c32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:54.807699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6293e-881f-400a-9f67-9957427f5c32 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:54.823975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 647/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 26 07:17:54 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:17:56.870413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c247-ff06-4789-a970-e07d994146d0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:56.870952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c247-ff06-4789-a970-e07d994146d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:56.870952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c247-ff06-4789-a970-e07d994146d0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:56.872367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 649/1296] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:17:56.880232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20c6e-9b61-4ccf-8637-da525ea819f9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:56.880758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20c6e-9b61-4ccf-8637-da525ea819f9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:56.880758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20c6e-9b61-4ccf-8637-da525ea819f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:56.900177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b2b20c6e-9b61-4ccf-8637-da525ea819f9 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:56.901316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b2b20c6e-9b61-4ccf-8637-da525ea819f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:56.978126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 648/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:57.004818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6c247-ff06-4789-a970-e07d994146d0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:57.144538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6c247-ff06-4789-a970-e07d994146d0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:57.179181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63533d2d-f264-4df4-bf83-a03fa382fd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:57.179724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63533d2d-f264-4df4-bf83-a03fa382fd56 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:57.179970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63533d2d-f264-4df4-bf83-a03fa382fd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:57.180271 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63533d2d-f264-4df4-bf83-a03fa382fd56 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:57.180889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63533d2d-f264-4df4-bf83-a03fa382fd56 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:57.182322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63533d2d-f264-4df4-bf83-a03fa382fd56 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-63533d2d-f264-4df4-bf83-a03fa382fd56 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:17:57.191097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:17:57.192325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:17:57.193330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 650/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:17:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:17:57.198860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20c6e-9b61-4ccf-8637-da525ea819f9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:57.217115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:57.302071 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20c6e-9b61-4ccf-8637-da525ea819f9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:57.336187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e0ffb-fee9-44af-8737-eacd92a7e51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:57.336811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e0ffb-fee9-44af-8737-eacd92a7e51e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:57.337144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e0ffb-fee9-44af-8737-eacd92a7e51e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:57.337382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e0ffb-fee9-44af-8737-eacd92a7e51e None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:57.338131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e0ffb-fee9-44af-8737-eacd92a7e51e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:57.338395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e0ffb-fee9-44af-8737-eacd92a7e51e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:57.340200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e0ffb-fee9-44af-8737-eacd92a7e51e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:57.345569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 649/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 26 07:17:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:57.351832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63533d2d-f264-4df4-bf83-a03fa382fd56 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:57.387821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:57.476221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63533d2d-f264-4df4-bf83-a03fa382fd56 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:57.516600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5f235-005a-4495-846c-efa7eb667d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:57.517244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5f235-005a-4495-846c-efa7eb667d26 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:57.517557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5f235-005a-4495-846c-efa7eb667d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:57.517826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5f235-005a-4495-846c-efa7eb667d26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:57.518604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5f235-005a-4495-846c-efa7eb667d26 None admin] RBAC: Adding query filter params (interface=public, service_id=c97355d7a18f4c7ab85789390e2777ae, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:17:57.518938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5f235-005a-4495-846c-efa7eb667d26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:57.520354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5f235-005a-4495-846c-efa7eb667d26 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:57.526566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 651/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 26 07:17:57 2022] GET /identity/v3/endpoints?service_id=c97355d7a18f4c7ab85789390e2777ae&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:17:57.532923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e0ffb-fee9-44af-8737-eacd92a7e51e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:57.621016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:57.642405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e0ffb-fee9-44af-8737-eacd92a7e51e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:17:57.681691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f8791-300e-4049-992d-537741549ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:17:57.682336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f8791-300e-4049-992d-537741549ebf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:57.682612 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f8791-300e-4049-992d-537741549ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:57.682884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f8791-300e-4049-992d-537741549ebf None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:57.683548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f8791-300e-4049-992d-537741549ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:17:57.686708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f8791-300e-4049-992d-537741549ebf None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:17:57.695291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 650/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 26 07:17:57 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:17:59.735672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2deb-6f40-4d1b-9bcc-2e148ac5fc58 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:59.736262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2deb-6f40-4d1b-9bcc-2e148ac5fc58 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:59.736262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2deb-6f40-4d1b-9bcc-2e148ac5fc58 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:59.737692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 652/1302] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:17:59.743474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c5eb-1a2f-4942-ad51-e62f18e32db1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:17:59.744220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c5eb-1a2f-4942-ad51-e62f18e32db1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:17:59.744220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c5eb-1a2f-4942-ad51-e62f18e32db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:17:59.763323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5130c5eb-1a2f-4942-ad51-e62f18e32db1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:17:59.764577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5130c5eb-1a2f-4942-ad51-e62f18e32db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:17:59.838155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 651/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:17:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:17:59.861391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b2deb-6f40-4d1b-9bcc-2e148ac5fc58 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:17:59.966064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:17:59.976477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b2deb-6f40-4d1b-9bcc-2e148ac5fc58 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:18:00.014782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b0423-dfef-4f3b-8008-eeceba67f2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:18:00.015441 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b0423-dfef-4f3b-8008-eeceba67f2fc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:18:00.015719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b0423-dfef-4f3b-8008-eeceba67f2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:18:00.015988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b0423-dfef-4f3b-8008-eeceba67f2fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:18:00.016622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b0423-dfef-4f3b-8008-eeceba67f2fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:18:00.018025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b0423-dfef-4f3b-8008-eeceba67f2fc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ba0b0423-dfef-4f3b-8008-eeceba67f2fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:18:00.027300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:18:00.028913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 26 07:18:00.029980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 653/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 26 07:17:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:18:00.035006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130c5eb-1a2f-4942-ad51-e62f18e32db1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:18:00.115139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:18:00.139450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130c5eb-1a2f-4942-ad51-e62f18e32db1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:18:00.175829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92584b-1cad-4d0f-a8c6-e7aded1be9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:18:00.176470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92584b-1cad-4d0f-a8c6-e7aded1be9dd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:18:00.176749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92584b-1cad-4d0f-a8c6-e7aded1be9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:18:00.177025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92584b-1cad-4d0f-a8c6-e7aded1be9dd None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:18:00.177752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92584b-1cad-4d0f-a8c6-e7aded1be9dd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:18:00.178058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92584b-1cad-4d0f-a8c6-e7aded1be9dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:18:00.179441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92584b-1cad-4d0f-a8c6-e7aded1be9dd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:18:00.184881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 652/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 26 07:18:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:18:00.193754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b0423-dfef-4f3b-8008-eeceba67f2fc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:18:00.331367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b0423-dfef-4f3b-8008-eeceba67f2fc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:18:00.392860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b55ffb-e60b-4eab-b46f-79bf198c531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:18:00.393950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55ffb-e60b-4eab-b46f-79bf198c531e None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:18:00.394403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55ffb-e60b-4eab-b46f-79bf198c531e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:18:00.394882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55ffb-e60b-4eab-b46f-79bf198c531e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:18:00.396234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b55ffb-e60b-4eab-b46f-79bf198c531e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:18:00.398892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b55ffb-e60b-4eab-b46f-79bf198c531e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:18:00.428685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 654/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:18:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:18:10.181767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=30 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:18:10.423810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:07.540454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847030-a767-40d5-9b4b-3d32dc4a56ff None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:07.540954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847030-a767-40d5-9b4b-3d32dc4a56ff None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:07.541052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847030-a767-40d5-9b4b-3d32dc4a56ff None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:07.547859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861692d-da5d-4ae4-9c8e-87035e78f9eb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:07.548294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861692d-da5d-4ae4-9c8e-87035e78f9eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:07.548389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861692d-da5d-4ae4-9c8e-87035e78f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:07.553173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 653/1307] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:07 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:07.765559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4861692d-da5d-4ae4-9c8e-87035e78f9eb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:07.767123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4861692d-da5d-4ae4-9c8e-87035e78f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:07.892255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 655/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:07.942752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5887-4441-4931-9bee-200371425e3a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:07.943037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5887-4441-4931-9bee-200371425e3a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:07.943455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5887-4441-4931-9bee-200371425e3a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:07.945169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 654/1309] 10.222.0.20 () {54 vars in 965 bytes} [Tue Jul 26 07:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:07.951540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803e9a8-dac1-4711-887e-a85f1c5e557b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:07.951825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803e9a8-dac1-4711-887e-a85f1c5e557b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:07.952130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803e9a8-dac1-4711-887e-a85f1c5e557b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:08.044468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7803e9a8-dac1-4711-887e-a85f1c5e557b None None] MFA Rules not processed for user `7eab2497edff4c968030b5b0d6814150`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:08.045877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7803e9a8-dac1-4711-887e-a85f1c5e557b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:08.070581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:08.136022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 656/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Jul 26 07:19:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:08.145939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5887-4441-4931-9bee-200371425e3a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:08.147738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c08a5887-4441-4931-9bee-200371425e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:08.275988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5887-4441-4931-9bee-200371425e3a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:08.361348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b32d5-e269-4556-bc10-19509c8b68b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:08.361866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b32d5-e269-4556-bc10-19509c8b68b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:08.362143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b32d5-e269-4556-bc10-19509c8b68b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:08.362407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b32d5-e269-4556-bc10-19509c8b68b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:08.364104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2d3b32d5-e269-4556-bc10-19509c8b68b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:08.432560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:08.505790 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b32d5-e269-4556-bc10-19509c8b68b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:08.507287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b32d5-e269-4556-bc10-19509c8b68b3 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:08.529220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 655/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:10.831875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6784-2c91-450d-b1d8-5812e4f15299 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:10.832503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6784-2c91-450d-b1d8-5812e4f15299 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:10.832503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6784-2c91-450d-b1d8-5812e4f15299 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:10.833837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 657/1312] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:10.839608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2df6-f61f-48ef-8917-e78d57cd0202 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:10.840166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2df6-f61f-48ef-8917-e78d57cd0202 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:10.840446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2df6-f61f-48ef-8917-e78d57cd0202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:10.917641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f74d2df6-f61f-48ef-8917-e78d57cd0202 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:10.918873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f74d2df6-f61f-48ef-8917-e78d57cd0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:11.017707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 656/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:19:11.055853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb6784-2c91-450d-b1d8-5812e4f15299 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:11.057511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1feb6784-2c91-450d-b1d8-5812e4f15299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:11.167371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb6784-2c91-450d-b1d8-5812e4f15299 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:11.241955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:11.245404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c327d40-f202-4d4f-adaa-fd4596f63c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:11.246068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c327d40-f202-4d4f-adaa-fd4596f63c0d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:11.246356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c327d40-f202-4d4f-adaa-fd4596f63c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:11.246632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c327d40-f202-4d4f-adaa-fd4596f63c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:11.249278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c327d40-f202-4d4f-adaa-fd4596f63c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:11.371628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c327d40-f202-4d4f-adaa-fd4596f63c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:11.373119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c327d40-f202-4d4f-adaa-fd4596f63c0d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:11.392494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 658/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:13.727798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce4c0-6efa-40b2-b327-d22427ce8e2f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:13.728356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce4c0-6efa-40b2-b327-d22427ce8e2f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:13.728356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce4c0-6efa-40b2-b327-d22427ce8e2f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:13.729766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 657/1315] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:13.735371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64dd74-9df7-447d-9eec-4e9287149c49 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:13.735826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64dd74-9df7-447d-9eec-4e9287149c49 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:13.735918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64dd74-9df7-447d-9eec-4e9287149c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:13.808122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ed64dd74-9df7-447d-9eec-4e9287149c49 None None] MFA Rules not processed for user `66d89ddc6ddc4301a34002851e393306`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:13.809386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ed64dd74-9df7-447d-9eec-4e9287149c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:13.863185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:13.908345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 659/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:13.947852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce4c0-6efa-40b2-b327-d22427ce8e2f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:13.949455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e1cce4c0-6efa-40b2-b327-d22427ce8e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:13.959503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:14.067025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce4c0-6efa-40b2-b327-d22427ce8e2f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:14.146284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd56cf-e856-48b5-9c55-8597663e664c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:14.146894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd56cf-e856-48b5-9c55-8597663e664c service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:14.147166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd56cf-e856-48b5-9c55-8597663e664c service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:14.147434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd56cf-e856-48b5-9c55-8597663e664c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:14.149241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a8bd56cf-e856-48b5-9c55-8597663e664c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:14.215002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:14.267696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd56cf-e856-48b5-9c55-8597663e664c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:14.269152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd56cf-e856-48b5-9c55-8597663e664c service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:14.287873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 658/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:16.876999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190f7c-c086-4e9d-b37f-3700d1660017 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:16.877479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190f7c-c086-4e9d-b37f-3700d1660017 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:16.877570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190f7c-c086-4e9d-b37f-3700d1660017 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:16.878988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 660/1318] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:16.884517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346e176-5e3b-4ef6-9f5c-e2130effbc37 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:16.885000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346e176-5e3b-4ef6-9f5c-e2130effbc37 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:16.885098 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346e176-5e3b-4ef6-9f5c-e2130effbc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:16.970484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6346e176-5e3b-4ef6-9f5c-e2130effbc37 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:16.971761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6346e176-5e3b-4ef6-9f5c-e2130effbc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:17.075890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 659/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:17.114732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190f7c-c086-4e9d-b37f-3700d1660017 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:17.116407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ad190f7c-c086-4e9d-b37f-3700d1660017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:17.227279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190f7c-c086-4e9d-b37f-3700d1660017 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:17.307582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209d252-3d74-4da5-82f7-b01b439a5861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:17.308223 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d252-3d74-4da5-82f7-b01b439a5861 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:17.308505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d252-3d74-4da5-82f7-b01b439a5861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:17.308780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d252-3d74-4da5-82f7-b01b439a5861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:17.310484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1209d252-3d74-4da5-82f7-b01b439a5861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:17.318490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:17.438399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209d252-3d74-4da5-82f7-b01b439a5861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:17.439873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209d252-3d74-4da5-82f7-b01b439a5861 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:17.462891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 661/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:20.185563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893873d-340a-4828-b66e-c87435d8cb40 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:20.186181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893873d-340a-4828-b66e-c87435d8cb40 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:20.186181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893873d-340a-4828-b66e-c87435d8cb40 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:20.187700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 660/1321] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:20.192935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6d71-122a-45d4-b4d2-42e908ef960d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:20.193443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6d71-122a-45d4-b4d2-42e908ef960d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:20.193564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6d71-122a-45d4-b4d2-42e908ef960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:20.265750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9bea6d71-122a-45d4-b4d2-42e908ef960d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:20.267091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9bea6d71-122a-45d4-b4d2-42e908ef960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:20.326655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:20.375069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 662/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:20.424862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c696dd6-2414-4151-8b70-dfa534e1eed9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:20.425102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c696dd6-2414-4151-8b70-dfa534e1eed9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:20.425429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c696dd6-2414-4151-8b70-dfa534e1eed9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:20.426811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 661/1323] 10.222.0.20 () {54 vars in 965 bytes} [Tue Jul 26 07:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:20.433504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe8625-9c63-48ef-9d96-781b31f8d445 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:20.433829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe8625-9c63-48ef-9d96-781b31f8d445 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:20.434100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe8625-9c63-48ef-9d96-781b31f8d445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:20.519995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7abe8625-9c63-48ef-9d96-781b31f8d445 None None] MFA Rules not processed for user `7eab2497edff4c968030b5b0d6814150`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:20.521215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7abe8625-9c63-48ef-9d96-781b31f8d445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:20.603755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 663/1324] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Jul 26 07:19:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:20.612981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c696dd6-2414-4151-8b70-dfa534e1eed9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:20.614584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6c696dd6-2414-4151-8b70-dfa534e1eed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:20.634994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:20.732766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c696dd6-2414-4151-8b70-dfa534e1eed9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:20.815210 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4450-2f8f-4500-870f-da74eb53faa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:20.815724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4450-2f8f-4500-870f-da74eb53faa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:20.816003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4450-2f8f-4500-870f-da74eb53faa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:20.816251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4450-2f8f-4500-870f-da74eb53faa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:20.817946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f67d4450-2f8f-4500-870f-da74eb53faa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:20.894441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:20.935869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d4450-2f8f-4500-870f-da74eb53faa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:20.937318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d4450-2f8f-4500-870f-da74eb53faa2 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:20.956396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 662/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:23.235583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be9298-59d1-47d9-9088-51ca261c58e0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:23.236194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be9298-59d1-47d9-9088-51ca261c58e0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:23.236194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be9298-59d1-47d9-9088-51ca261c58e0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:23.237623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 664/1326] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:19:23.243487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475bcf0-095b-4a50-9a7c-463de0010980 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:23.244036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475bcf0-095b-4a50-9a7c-463de0010980 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:23.244285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475bcf0-095b-4a50-9a7c-463de0010980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:23.318624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1475bcf0-095b-4a50-9a7c-463de0010980 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:23.319920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1475bcf0-095b-4a50-9a7c-463de0010980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:23.422708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 663/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:23.458658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be9298-59d1-47d9-9088-51ca261c58e0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:23.460209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d4be9298-59d1-47d9-9088-51ca261c58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:23.532364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:23.583123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be9298-59d1-47d9-9088-51ca261c58e0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:23.663350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e029-59cc-470d-8e63-8068522690d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:23.663990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e029-59cc-470d-8e63-8068522690d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:23.664268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e029-59cc-470d-8e63-8068522690d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:23.664538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e029-59cc-470d-8e63-8068522690d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:23.666236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39d0e029-59cc-470d-8e63-8068522690d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:23.786770 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:23.788911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0e029-59cc-470d-8e63-8068522690d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:23.790699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0e029-59cc-470d-8e63-8068522690d0 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:23.810806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 665/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:25.889701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af876-3378-4940-92bb-729992d044cb None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:25.890266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af876-3378-4940-92bb-729992d044cb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:25.890548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af876-3378-4940-92bb-729992d044cb None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:25.892941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 664/1329] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:25.899232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee854a-c425-489c-abdc-fdbf38a07102 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:25.899763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee854a-c425-489c-abdc-fdbf38a07102 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:25.899763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee854a-c425-489c-abdc-fdbf38a07102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:25.976769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-70ee854a-c425-489c-abdc-fdbf38a07102 None None] MFA Rules not processed for user `66d89ddc6ddc4301a34002851e393306`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:25.978036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-70ee854a-c425-489c-abdc-fdbf38a07102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:26.076464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 666/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:26.115807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af876-3378-4940-92bb-729992d044cb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:26.117421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-055af876-3378-4940-92bb-729992d044cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:26.173859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:26.271386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af876-3378-4940-92bb-729992d044cb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:26.353606 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f8c38-4d2e-4fe2-9c29-299ef109f624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:26.354252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f8c38-4d2e-4fe2-9c29-299ef109f624 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:26.354534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f8c38-4d2e-4fe2-9c29-299ef109f624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:26.354806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f8c38-4d2e-4fe2-9c29-299ef109f624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:26.356604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d43f8c38-4d2e-4fe2-9c29-299ef109f624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:26.441957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:26.482533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f8c38-4d2e-4fe2-9c29-299ef109f624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:26.484052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f8c38-4d2e-4fe2-9c29-299ef109f624 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:26.506464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 665/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:28.974164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08743b-5802-4c30-a863-a501fe6db42e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:28.974993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08743b-5802-4c30-a863-a501fe6db42e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:28.975344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08743b-5802-4c30-a863-a501fe6db42e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:28.977140 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 667/1332] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:28.984615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a614a-b6a6-4e9c-9bfb-9b32455eaf90 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:28.985125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a614a-b6a6-4e9c-9bfb-9b32455eaf90 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:28.985286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a614a-b6a6-4e9c-9bfb-9b32455eaf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:29.064676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d17a614a-b6a6-4e9c-9bfb-9b32455eaf90 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:29.066300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d17a614a-b6a6-4e9c-9bfb-9b32455eaf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:29.174191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 666/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:29.212375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08743b-5802-4c30-a863-a501fe6db42e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:29.214658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bb08743b-5802-4c30-a863-a501fe6db42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:29.312152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:29.359783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08743b-5802-4c30-a863-a501fe6db42e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:29.440513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b10de2-30b4-4a6f-966c-1ae978a627d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:29.441553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10de2-30b4-4a6f-966c-1ae978a627d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:29.441839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10de2-30b4-4a6f-966c-1ae978a627d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:29.442116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10de2-30b4-4a6f-966c-1ae978a627d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:29.443854 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d2b10de2-30b4-4a6f-966c-1ae978a627d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:29.574965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b10de2-30b4-4a6f-966c-1ae978a627d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:29.576466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b10de2-30b4-4a6f-966c-1ae978a627d4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:29.588452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:29.598665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 668/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:31.732593 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bcd9d-3e80-4d8e-81a8-b162b7276021 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:31.733217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bcd9d-3e80-4d8e-81a8-b162b7276021 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:31.733217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bcd9d-3e80-4d8e-81a8-b162b7276021 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:31.734627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 667/1335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:31.740865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012fb05-fd60-4a76-9c55-ab3835c978d2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:31.741454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012fb05-fd60-4a76-9c55-ab3835c978d2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:31.741454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012fb05-fd60-4a76-9c55-ab3835c978d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:31.808937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f012fb05-fd60-4a76-9c55-ab3835c978d2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:31.810426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f012fb05-fd60-4a76-9c55-ab3835c978d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:31.910610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 669/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:31.951134 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bcd9d-3e80-4d8e-81a8-b162b7276021 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:31.952834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5d9bcd9d-3e80-4d8e-81a8-b162b7276021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:31.997195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:32.077980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bcd9d-3e80-4d8e-81a8-b162b7276021 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:32.157275 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b42f6-30b1-425b-8341-8dd9f1c353f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:32.157925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b42f6-30b1-425b-8341-8dd9f1c353f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:32.158204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b42f6-30b1-425b-8341-8dd9f1c353f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:32.158472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b42f6-30b1-425b-8341-8dd9f1c353f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:32.160151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4d7b42f6-30b1-425b-8341-8dd9f1c353f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:32.247145 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:32.274634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b42f6-30b1-425b-8341-8dd9f1c353f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:32.276216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b42f6-30b1-425b-8341-8dd9f1c353f8 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:32.294762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 668/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:34.664125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3f766-9758-4f4d-bb5c-d26389639adc None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:34.664743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3f766-9758-4f4d-bb5c-d26389639adc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:34.664743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3f766-9758-4f4d-bb5c-d26389639adc None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:34.666138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 670/1338] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:34.671821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a09df-adb1-46a5-8c1e-e00c8806010a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:34.672294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a09df-adb1-46a5-8c1e-e00c8806010a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:34.672400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a09df-adb1-46a5-8c1e-e00c8806010a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:34.743314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-931a09df-adb1-46a5-8c1e-e00c8806010a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:34.744586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-931a09df-adb1-46a5-8c1e-e00c8806010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:34.865953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 669/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:34.901948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3f766-9758-4f4d-bb5c-d26389639adc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:34.903468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cea3f766-9758-4f4d-bb5c-d26389639adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:34.985732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:35.015532 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3f766-9758-4f4d-bb5c-d26389639adc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:35.097710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1e25c-1de2-458b-9991-ac0525775ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:35.098347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1e25c-1de2-458b-9991-ac0525775ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:35.098619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1e25c-1de2-458b-9991-ac0525775ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:35.098883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1e25c-1de2-458b-9991-ac0525775ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:35.100538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cfc1e25c-1de2-458b-9991-ac0525775ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:35.218428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1e25c-1de2-458b-9991-ac0525775ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:35.219924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1e25c-1de2-458b-9991-ac0525775ac5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:35.239824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 671/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:39.256194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cfb41-0cc8-45d2-b134-a7c89badf86f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:39.256669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cfb41-0cc8-45d2-b134-a7c89badf86f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:39.256791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cfb41-0cc8-45d2-b134-a7c89badf86f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:39.258117 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 670/1341] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:39.263772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e2df-8f19-4cc6-811a-629a78862ca0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:39.264277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e2df-8f19-4cc6-811a-629a78862ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:39.264528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e2df-8f19-4cc6-811a-629a78862ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:39.271168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:39.345329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b5b3e2df-8f19-4cc6-811a-629a78862ca0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:39.346939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b5b3e2df-8f19-4cc6-811a-629a78862ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:39.452526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 672/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:19:39.491437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cfb41-0cc8-45d2-b134-a7c89badf86f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:39.492975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-930cfb41-0cc8-45d2-b134-a7c89badf86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:39.542053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:39.599790 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cfb41-0cc8-45d2-b134-a7c89badf86f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:39.677632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc9eeb-204f-4798-b051-14f928e735f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:39.678386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc9eeb-204f-4798-b051-14f928e735f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:39.678664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc9eeb-204f-4798-b051-14f928e735f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:39.678935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc9eeb-204f-4798-b051-14f928e735f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:39.680743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a9dc9eeb-204f-4798-b051-14f928e735f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:39.782497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:39.799964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc9eeb-204f-4798-b051-14f928e735f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:39.801617 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc9eeb-204f-4798-b051-14f928e735f0 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:39.820628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 671/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:42.480825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e9756-f9e9-4f4c-ae9b-d4c59dceee35 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:42.481447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e9756-f9e9-4f4c-ae9b-d4c59dceee35 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:42.481447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e9756-f9e9-4f4c-ae9b-d4c59dceee35 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:42.483062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 673/1344] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:42.488681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892ebd0-62c8-40b3-a9f6-97a3612aabab None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:42.489171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892ebd0-62c8-40b3-a9f6-97a3612aabab None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:42.489295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892ebd0-62c8-40b3-a9f6-97a3612aabab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:42.567197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d892ebd0-62c8-40b3-a9f6-97a3612aabab None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:42.568654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d892ebd0-62c8-40b3-a9f6-97a3612aabab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:42.682198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 672/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:42.720738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e9756-f9e9-4f4c-ae9b-d4c59dceee35 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:42.722327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-905e9756-f9e9-4f4c-ae9b-d4c59dceee35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:42.816425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:42.834385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e9756-f9e9-4f4c-ae9b-d4c59dceee35 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:42.910994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5fe9e-4e68-43c9-9aa1-f81addd65cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:42.911633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5fe9e-4e68-43c9-9aa1-f81addd65cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:42.911902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5fe9e-4e68-43c9-9aa1-f81addd65cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:42.912168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5fe9e-4e68-43c9-9aa1-f81addd65cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:42.913802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dcb5fe9e-4e68-43c9-9aa1-f81addd65cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:43.029738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5fe9e-4e68-43c9-9aa1-f81addd65cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:43.031665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5fe9e-4e68-43c9-9aa1-f81addd65cc5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:43.051502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 674/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:47.439503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79bb42-66a1-42eb-8285-d8629ce9e4f6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:47.440073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79bb42-66a1-42eb-8285-d8629ce9e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:47.440073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79bb42-66a1-42eb-8285-d8629ce9e4f6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:47.443588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 673/1347] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:47.447089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee974a-32d8-4142-b498-7027b34132cf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:47.447564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee974a-32d8-4142-b498-7027b34132cf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:47.447667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee974a-32d8-4142-b498-7027b34132cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:47.466378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:47.523639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0bee974a-32d8-4142-b498-7027b34132cf None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:47.524903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0bee974a-32d8-4142-b498-7027b34132cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:47.638419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 675/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:47.676459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79bb42-66a1-42eb-8285-d8629ce9e4f6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:19:47.678065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7e79bb42-66a1-42eb-8285-d8629ce9e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:47.742688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:47.792646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79bb42-66a1-42eb-8285-d8629ce9e4f6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:19:47.882193 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da558b-9b37-43e7-968c-b2bc27cefaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:19:47.882848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da558b-9b37-43e7-968c-b2bc27cefaee service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:47.883127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da558b-9b37-43e7-968c-b2bc27cefaee service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:47.883400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da558b-9b37-43e7-968c-b2bc27cefaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:47.885159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-20da558b-9b37-43e7-968c-b2bc27cefaee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:48.005806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:48.009753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da558b-9b37-43e7-968c-b2bc27cefaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:19:48.011754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da558b-9b37-43e7-968c-b2bc27cefaee service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:19:48.032337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 674/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:19:53.001486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d366-c872-4156-9afb-843532cc6a00 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:53.002039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d366-c872-4156-9afb-843532cc6a00 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:53.002256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d366-c872-4156-9afb-843532cc6a00 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:53.004017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 676/1350] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:53.011834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d47296-369c-4fec-8ecf-d9b21a26a1d8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:53.012317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d47296-369c-4fec-8ecf-d9b21a26a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:53.014009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d47296-369c-4fec-8ecf-d9b21a26a1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:53.136353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-63d47296-369c-4fec-8ecf-d9b21a26a1d8 None None] MFA Rules not processed for user `826fd481bf2e40d6917bb604591a75cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:53.138018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-63d47296-369c-4fec-8ecf-d9b21a26a1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:53.270312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 675/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:19:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:57.488544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f0bb-6293-44eb-9153-2a4174c17833 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:57.489465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f0bb-6293-44eb-9153-2a4174c17833 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:57.489737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f0bb-6293-44eb-9153-2a4174c17833 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:57.491356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 677/1352] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:57.496658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32342a-e4ba-4af0-8ff1-fcb0bdd1340f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:57.497359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32342a-e4ba-4af0-8ff1-fcb0bdd1340f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:57.497699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32342a-e4ba-4af0-8ff1-fcb0bdd1340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:57.564685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:57.590588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ac32342a-e4ba-4af0-8ff1-fcb0bdd1340f None None] MFA Rules not processed for user `826fd481bf2e40d6917bb604591a75cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:57.591892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ac32342a-e4ba-4af0-8ff1-fcb0bdd1340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:57.636158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=59 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:57.715391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 676/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:19:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:19:58.961806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91425539-b85e-4249-9944-ea57ccf927a5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:58.962348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91425539-b85e-4249-9944-ea57ccf927a5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:58.962348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91425539-b85e-4249-9944-ea57ccf927a5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:58.963763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 678/1354] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:19:58.969293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc3ae-0fc5-4ca2-a7be-f5fd9d577699 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:19:58.969764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc3ae-0fc5-4ca2-a7be-f5fd9d577699 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:19:58.969885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc3ae-0fc5-4ca2-a7be-f5fd9d577699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:19:59.053699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bfacc3ae-0fc5-4ca2-a7be-f5fd9d577699 None None] MFA Rules not processed for user `826fd481bf2e40d6917bb604591a75cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:19:59.054973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bfacc3ae-0fc5-4ca2-a7be-f5fd9d577699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:19:59.098891 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:19:59.172185 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 677/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:19:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:20:02.634960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e724a4-7996-4cf8-9a70-f5451f428588 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:02.636259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e724a4-7996-4cf8-9a70-f5451f428588 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:02.636259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e724a4-7996-4cf8-9a70-f5451f428588 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:02.636774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 679/1356] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:02.644830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f029d8d-f1d3-48d0-bafd-78a9aaf42830 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:02.645378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f029d8d-f1d3-48d0-bafd-78a9aaf42830 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:02.646486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f029d8d-f1d3-48d0-bafd-78a9aaf42830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:02.742407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3f029d8d-f1d3-48d0-bafd-78a9aaf42830 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:02.745250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3f029d8d-f1d3-48d0-bafd-78a9aaf42830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:02.865321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 678/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:02.920857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf8e12-078b-4f00-a3ed-328e1b60553f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:02.921528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf8e12-078b-4f00-a3ed-328e1b60553f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:02.922111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf8e12-078b-4f00-a3ed-328e1b60553f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:02.923821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 680/1358] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jul 26 07:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:02.932619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5407234-167b-4d46-b98a-3b2494eac6a6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:02.933477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5407234-167b-4d46-b98a-3b2494eac6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:02.934105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5407234-167b-4d46-b98a-3b2494eac6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:02.959039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:03.030366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f5407234-167b-4d46-b98a-3b2494eac6a6 None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:03.031624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f5407234-167b-4d46-b98a-3b2494eac6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:03.161593 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 679/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jul 26 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:03.170548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf8e12-078b-4f00-a3ed-328e1b60553f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:03.172125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9cdf8e12-078b-4f00-a3ed-328e1b60553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:03.346024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf8e12-078b-4f00-a3ed-328e1b60553f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:03.423631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:03.470174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fa1b5-a59c-44e7-b9b1-e514ab140190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:03.470762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fa1b5-a59c-44e7-b9b1-e514ab140190 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:03.471047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fa1b5-a59c-44e7-b9b1-e514ab140190 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:03.471321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fa1b5-a59c-44e7-b9b1-e514ab140190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:03.473167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1b6fa1b5-a59c-44e7-b9b1-e514ab140190 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:03.608709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fa1b5-a59c-44e7-b9b1-e514ab140190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:03.611616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fa1b5-a59c-44e7-b9b1-e514ab140190 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:03.642717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 681/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:05.913829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedaaf0-4a95-466c-a18c-d7471693fd0b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:05.914386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedaaf0-4a95-466c-a18c-d7471693fd0b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:05.914386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedaaf0-4a95-466c-a18c-d7471693fd0b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:05.915881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 680/1361] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:05.921913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e74973-6782-4a94-b739-7716cab89644 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:05.922384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e74973-6782-4a94-b739-7716cab89644 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:05.922613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e74973-6782-4a94-b739-7716cab89644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:05.993854 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f9e74973-6782-4a94-b739-7716cab89644 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:05.994579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f9e74973-6782-4a94-b739-7716cab89644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:06.037925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:06.121558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 682/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:06.167725 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedaaf0-4a95-466c-a18c-d7471693fd0b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:06.169435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bdedaaf0-4a95-466c-a18c-d7471693fd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:06.243519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:06.335953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedaaf0-4a95-466c-a18c-d7471693fd0b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:06.466610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3700e-7e5a-4d1e-a2e0-592d5a9e66d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:06.467253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3700e-7e5a-4d1e-a2e0-592d5a9e66d9 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:06.467527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3700e-7e5a-4d1e-a2e0-592d5a9e66d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:06.467799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3700e-7e5a-4d1e-a2e0-592d5a9e66d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:06.469577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-26b3700e-7e5a-4d1e-a2e0-592d5a9e66d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:06.495191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:06.580071 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3700e-7e5a-4d1e-a2e0-592d5a9e66d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:06.582059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3700e-7e5a-4d1e-a2e0-592d5a9e66d9 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:06.604731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 681/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:08.993465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95dfe1-94bf-4663-972f-5b9074fac034 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:08.994434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95dfe1-94bf-4663-972f-5b9074fac034 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:08.994897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95dfe1-94bf-4663-972f-5b9074fac034 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:08.996580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 683/1364] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:20:09.004119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3016fe-2afd-4b48-b838-8fd54e7389dc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:09.004685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3016fe-2afd-4b48-b838-8fd54e7389dc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:09.005320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3016fe-2afd-4b48-b838-8fd54e7389dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:09.110062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ef3016fe-2afd-4b48-b838-8fd54e7389dc None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:09.111467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ef3016fe-2afd-4b48-b838-8fd54e7389dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:09.280424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:09.285137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 682/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:09.336423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a294cea-714e-4f18-9eed-25cfc57bf59a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:09.336705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a294cea-714e-4f18-9eed-25cfc57bf59a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:09.337041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a294cea-714e-4f18-9eed-25cfc57bf59a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:09.338716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 684/1366] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jul 26 07:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:09.345273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d290d9a-43c6-417c-a4fa-794c55a7c9ae None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:09.345594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d290d9a-43c6-417c-a4fa-794c55a7c9ae None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:09.345933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d290d9a-43c6-417c-a4fa-794c55a7c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:09.456186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3d290d9a-43c6-417c-a4fa-794c55a7c9ae None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:09.457451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3d290d9a-43c6-417c-a4fa-794c55a7c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:09.648471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 683/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jul 26 07:20:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:09.656377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a294cea-714e-4f18-9eed-25cfc57bf59a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:09.657943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a294cea-714e-4f18-9eed-25cfc57bf59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:09.854095 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a294cea-714e-4f18-9eed-25cfc57bf59a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:09.877834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:10.004916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808fd8d-b831-42f1-9764-cfaee7f2d5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:10.006157 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808fd8d-b831-42f1-9764-cfaee7f2d5a8 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:10.006157 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808fd8d-b831-42f1-9764-cfaee7f2d5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:10.006435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808fd8d-b831-42f1-9764-cfaee7f2d5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:10.008294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c808fd8d-b831-42f1-9764-cfaee7f2d5a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:10.134292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808fd8d-b831-42f1-9764-cfaee7f2d5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:10.135874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808fd8d-b831-42f1-9764-cfaee7f2d5a8 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:10.166028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 685/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:11.043559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4b575-c579-482b-9cc0-309d4c1685ee None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:11.044127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4b575-c579-482b-9cc0-309d4c1685ee None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:11.044127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4b575-c579-482b-9cc0-309d4c1685ee None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:11.045784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 684/1369] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:11.051151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72309a-b882-4cc8-b0ac-c35ab7abbd18 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:11.051750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72309a-b882-4cc8-b0ac-c35ab7abbd18 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:11.051750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72309a-b882-4cc8-b0ac-c35ab7abbd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:11.086227 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:11.128214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5d72309a-b882-4cc8-b0ac-c35ab7abbd18 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:11.129532 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5d72309a-b882-4cc8-b0ac-c35ab7abbd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:11.264409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 686/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:11.610556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b873bb-9d06-453b-999e-535c43ce3bd7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:11.610556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b873bb-9d06-453b-999e-535c43ce3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:11.610556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b873bb-9d06-453b-999e-535c43ce3bd7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:11.613094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 685/1371] 10.222.0.20 () {54 vars in 964 bytes} [Tue Jul 26 07:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:11.618130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aad86-a851-4ce2-a453-d783fb677b43 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:11.618130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aad86-a851-4ce2-a453-d783fb677b43 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:11.618130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aad86-a851-4ce2-a453-d783fb677b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:11.705753 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9f0aad86-a851-4ce2-a453-d783fb677b43 None None] MFA Rules not processed for user `59f6195586c7434ab85604181ec2a076`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:11.707698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9f0aad86-a851-4ce2-a453-d783fb677b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:11.765835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:11.804218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 687/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Jul 26 07:20:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:20:11.811781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b873bb-9d06-453b-999e-535c43ce3bd7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:11.813361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e8b873bb-9d06-453b-999e-535c43ce3bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:11.869914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:11.941771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b873bb-9d06-453b-999e-535c43ce3bd7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:12.047840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620a4d6-b9f3-4c59-91e3-9d59518f9118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:12.048830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620a4d6-b9f3-4c59-91e3-9d59518f9118 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:12.048830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620a4d6-b9f3-4c59-91e3-9d59518f9118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:12.049484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620a4d6-b9f3-4c59-91e3-9d59518f9118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:12.050689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e620a4d6-b9f3-4c59-91e3-9d59518f9118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:12.168061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:12.183782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620a4d6-b9f3-4c59-91e3-9d59518f9118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:12.185373 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620a4d6-b9f3-4c59-91e3-9d59518f9118 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:12.217075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 686/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:12.399941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3d2f2-e630-43ed-aee6-06ef0daf0a12 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:12.400505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3d2f2-e630-43ed-aee6-06ef0daf0a12 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:12.400691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3d2f2-e630-43ed-aee6-06ef0daf0a12 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:12.402817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 688/1374] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:20:12.408796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187837cf-f402-4608-9da1-8749a7909fc6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:12.409083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187837cf-f402-4608-9da1-8749a7909fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:12.409406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187837cf-f402-4608-9da1-8749a7909fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:12.482061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-187837cf-f402-4608-9da1-8749a7909fc6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:12.483319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-187837cf-f402-4608-9da1-8749a7909fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:12.594620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 687/1375] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:20:12.642471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3d2f2-e630-43ed-aee6-06ef0daf0a12 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:12.644101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39c3d2f2-e630-43ed-aee6-06ef0daf0a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:12.794107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3d2f2-e630-43ed-aee6-06ef0daf0a12 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:12.847715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:12.913841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed48e9e-3669-44b0-9086-0955fa655686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:12.914568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48e9e-3669-44b0-9086-0955fa655686 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:12.914916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48e9e-3669-44b0-9086-0955fa655686 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:12.915256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48e9e-3669-44b0-9086-0955fa655686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:12.916993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6ed48e9e-3669-44b0-9086-0955fa655686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:13.007717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48e9e-3669-44b0-9086-0955fa655686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:13.009505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48e9e-3669-44b0-9086-0955fa655686 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:13.027651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 689/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:15.071708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b8576-97fa-4cee-8e80-972f011dee72 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:15.072261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b8576-97fa-4cee-8e80-972f011dee72 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:15.072261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b8576-97fa-4cee-8e80-972f011dee72 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:15.073713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 688/1377] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:15.079315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c661861-98f0-43de-bdd7-0fa86c903399 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:15.079777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c661861-98f0-43de-bdd7-0fa86c903399 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:15.079891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c661861-98f0-43de-bdd7-0fa86c903399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:15.150936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6c661861-98f0-43de-bdd7-0fa86c903399 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:15.152935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6c661861-98f0-43de-bdd7-0fa86c903399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:15.159910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:15.278308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 690/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:15.320228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b8576-97fa-4cee-8e80-972f011dee72 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:15.321890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-256b8576-97fa-4cee-8e80-972f011dee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:15.384321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:15.472421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b8576-97fa-4cee-8e80-972f011dee72 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:15.601465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1252-32e6-4652-a9d9-c62ce013c795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:15.602115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1252-32e6-4652-a9d9-c62ce013c795 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:15.602381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1252-32e6-4652-a9d9-c62ce013c795 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:15.602647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1252-32e6-4652-a9d9-c62ce013c795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:15.604545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-de7c1252-32e6-4652-a9d9-c62ce013c795 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:15.638740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:15.739475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c1252-32e6-4652-a9d9-c62ce013c795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:15.740999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c1252-32e6-4652-a9d9-c62ce013c795 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:15.773591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 689/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:17.818959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c412d-d090-45b1-99fe-45aed8efde46 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:17.819546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c412d-d090-45b1-99fe-45aed8efde46 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:17.819546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c412d-d090-45b1-99fe-45aed8efde46 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:17.820863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 691/1380] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:20:17.826916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c422f-8bbb-4bc6-81b0-d0124af4ffba None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:17.827468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c422f-8bbb-4bc6-81b0-d0124af4ffba None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:17.827636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c422f-8bbb-4bc6-81b0-d0124af4ffba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:17.905424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-854c422f-8bbb-4bc6-81b0-d0124af4ffba None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:17.906685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-854c422f-8bbb-4bc6-81b0-d0124af4ffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:18.009610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:18.020542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 690/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:18.066459 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c412d-d090-45b1-99fe-45aed8efde46 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:18.068379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e12c412d-d090-45b1-99fe-45aed8efde46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:18.227515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:18.245433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c412d-d090-45b1-99fe-45aed8efde46 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:18.380069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa03bb1-4dce-4cbb-956f-0d8621ff1ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:18.380811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa03bb1-4dce-4cbb-956f-0d8621ff1ff0 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:18.381142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa03bb1-4dce-4cbb-956f-0d8621ff1ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:18.381540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa03bb1-4dce-4cbb-956f-0d8621ff1ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:18.383248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8fa03bb1-4dce-4cbb-956f-0d8621ff1ff0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:18.484201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa03bb1-4dce-4cbb-956f-0d8621ff1ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:18.485941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa03bb1-4dce-4cbb-956f-0d8621ff1ff0 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:18.498038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:18.523757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 692/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:20.578242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07ec2-508a-4b3d-8e6f-d8332e8bae72 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:20.578847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07ec2-508a-4b3d-8e6f-d8332e8bae72 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:20.578950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07ec2-508a-4b3d-8e6f-d8332e8bae72 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:20.580795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 691/1383] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:20.586527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67029892-fde8-4fda-bcc4-46b5a298facd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:20.586980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67029892-fde8-4fda-bcc4-46b5a298facd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:20.587211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67029892-fde8-4fda-bcc4-46b5a298facd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:20.656605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-67029892-fde8-4fda-bcc4-46b5a298facd None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:20.658318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-67029892-fde8-4fda-bcc4-46b5a298facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:20.801384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 693/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:20:20.844788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07ec2-508a-4b3d-8e6f-d8332e8bae72 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:20.846452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-34c07ec2-508a-4b3d-8e6f-d8332e8bae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:21.034014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07ec2-508a-4b3d-8e6f-d8332e8bae72 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:21.127490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:21.184958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74b2eb-a11d-4f9a-b463-b661619cca18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:21.186086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74b2eb-a11d-4f9a-b463-b661619cca18 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:21.186747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74b2eb-a11d-4f9a-b463-b661619cca18 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:21.187103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74b2eb-a11d-4f9a-b463-b661619cca18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:21.189758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ef74b2eb-a11d-4f9a-b463-b661619cca18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:21.311403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74b2eb-a11d-4f9a-b463-b661619cca18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:21.313162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74b2eb-a11d-4f9a-b463-b661619cca18 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:21.333925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 692/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:23.441831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbad4d-4439-4a00-be1b-130472b003ad None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:23.442472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbad4d-4439-4a00-be1b-130472b003ad None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:23.442472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbad4d-4439-4a00-be1b-130472b003ad None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:23.443824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 694/1386] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:23.452036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e61b-b14d-42fc-a4f8-5f6a04f2f299 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:23.452753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e61b-b14d-42fc-a4f8-5f6a04f2f299 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:23.452901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e61b-b14d-42fc-a4f8-5f6a04f2f299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:23.543781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-aa48e61b-b14d-42fc-a4f8-5f6a04f2f299 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:23.545833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aa48e61b-b14d-42fc-a4f8-5f6a04f2f299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:23.588690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:23.686522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 693/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:23.746902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbad4d-4439-4a00-be1b-130472b003ad None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:23.749036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d0bbad4d-4439-4a00-be1b-130472b003ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:23.846383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:23.934574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbad4d-4439-4a00-be1b-130472b003ad None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:24.072945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8a955-b197-4ddf-9023-f0f6b9cc7bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:24.073642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8a955-b197-4ddf-9023-f0f6b9cc7bab service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:24.073919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8a955-b197-4ddf-9023-f0f6b9cc7bab service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:24.074197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8a955-b197-4ddf-9023-f0f6b9cc7bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:24.075966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a3a8a955-b197-4ddf-9023-f0f6b9cc7bab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:24.118494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:24.179824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8a955-b197-4ddf-9023-f0f6b9cc7bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:24.181596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8a955-b197-4ddf-9023-f0f6b9cc7bab service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:24.203676 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 695/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:26.379049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43178a-b31b-4fcc-8f9e-df964932f148 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:26.382155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43178a-b31b-4fcc-8f9e-df964932f148 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:26.382155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43178a-b31b-4fcc-8f9e-df964932f148 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:26.382155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 694/1389] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:26.387349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dbcd8-5437-4ebd-8ac1-9e1c0f13e62f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:26.387861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dbcd8-5437-4ebd-8ac1-9e1c0f13e62f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:26.387861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dbcd8-5437-4ebd-8ac1-9e1c0f13e62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:26.457723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ac4dbcd8-5437-4ebd-8ac1-9e1c0f13e62f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:26.458982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac4dbcd8-5437-4ebd-8ac1-9e1c0f13e62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:26.569489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 696/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:26.615834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43178a-b31b-4fcc-8f9e-df964932f148 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:26.617563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ff43178a-b31b-4fcc-8f9e-df964932f148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:26.791787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43178a-b31b-4fcc-8f9e-df964932f148 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:26.809904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:26.935620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c507d-8e00-439e-aef7-34f66aa2af46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:26.936296 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c507d-8e00-439e-aef7-34f66aa2af46 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:26.936577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c507d-8e00-439e-aef7-34f66aa2af46 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:26.936967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c507d-8e00-439e-aef7-34f66aa2af46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:26.938634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6b7c507d-8e00-439e-aef7-34f66aa2af46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:27.049228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c507d-8e00-439e-aef7-34f66aa2af46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:27.050935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c507d-8e00-439e-aef7-34f66aa2af46 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:27.069689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 695/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:27.432690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755066c8-c7e9-4c60-a293-0a87957ef4b3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:27.433286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755066c8-c7e9-4c60-a293-0a87957ef4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:27.433286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755066c8-c7e9-4c60-a293-0a87957ef4b3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:27.434716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 697/1392] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:27.440247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7ba9-81e3-4b57-ad3a-71785d572a2c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:27.440777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7ba9-81e3-4b57-ad3a-71785d572a2c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:27.440777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7ba9-81e3-4b57-ad3a-71785d572a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:27.470880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:27.516009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-97db7ba9-81e3-4b57-ad3a-71785d572a2c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:27.517229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-97db7ba9-81e3-4b57-ad3a-71785d572a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:27.624452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 696/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:27.681411 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992094d-d01c-4bf0-a73f-3b4d45adf736 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:27.681954 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992094d-d01c-4bf0-a73f-3b4d45adf736 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:27.682210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992094d-d01c-4bf0-a73f-3b4d45adf736 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:27.683785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 698/1394] 10.222.0.20 () {54 vars in 966 bytes} [Tue Jul 26 07:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:27.689032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c379-d3cb-4a18-9cbf-f170240bb028 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:27.689354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c379-d3cb-4a18-9cbf-f170240bb028 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:27.689627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c379-d3cb-4a18-9cbf-f170240bb028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:27.770960 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-32f9c379-d3cb-4a18-9cbf-f170240bb028 None None] MFA Rules not processed for user `2ecb8054ea4249d18903b5998fa753d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:27.772191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-32f9c379-d3cb-4a18-9cbf-f170240bb028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:27.815573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:27.854934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 697/1395] 10.222.0.20 () {58 vars in 1063 bytes} [Tue Jul 26 07:20:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:27.862662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992094d-d01c-4bf0-a73f-3b4d45adf736 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:27.864308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d992094d-d01c-4bf0-a73f-3b4d45adf736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:27.879187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:27.982054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992094d-d01c-4bf0-a73f-3b4d45adf736 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:28.061571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284a871-a32d-4a84-8d01-ea3488fc91ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb8054ea4249d18903b5998fa753d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:28.062213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284a871-a32d-4a84-8d01-ea3488fc91ea service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:28.062491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284a871-a32d-4a84-8d01-ea3488fc91ea service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:28.062766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284a871-a32d-4a84-8d01-ea3488fc91ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:28.064411 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3284a871-a32d-4a84-8d01-ea3488fc91ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:28.136614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:28.181237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284a871-a32d-4a84-8d01-ea3488fc91ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:28.182737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284a871-a32d-4a84-8d01-ea3488fc91ea service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:28.205396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 699/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:28.967768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8966e0-e2e3-4f5a-9e0f-77f3cf428f56 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:28.968298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8966e0-e2e3-4f5a-9e0f-77f3cf428f56 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:28.968298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8966e0-e2e3-4f5a-9e0f-77f3cf428f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:29.051514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-be8966e0-e2e3-4f5a-9e0f-77f3cf428f56 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:29.052764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-be8966e0-e2e3-4f5a-9e0f-77f3cf428f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:29.116696 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d113b9-af82-4bdf-b841-f5957cf4654b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:29.117345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d113b9-af82-4bdf-b841-f5957cf4654b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:29.117345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d113b9-af82-4bdf-b841-f5957cf4654b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:29.118697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 700/1397] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:20:29.124358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc84a4e-b80e-4af5-a817-96224e02cde7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:29.124618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc84a4e-b80e-4af5-a817-96224e02cde7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:29.124920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc84a4e-b80e-4af5-a817-96224e02cde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:29.165417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 698/1398] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:20:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:29.211314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dbc84a4e-b80e-4af5-a817-96224e02cde7 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:29.212550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dbc84a4e-b80e-4af5-a817-96224e02cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:29.213767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9949a4-93ac-4844-98b2-b80b12eda270 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:29.214055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9949a4-93ac-4844-98b2-b80b12eda270 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:29.214348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9949a4-93ac-4844-98b2-b80b12eda270 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:29.215880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 699/1399] 10.222.0.20 () {54 vars in 943 bytes} [Tue Jul 26 07:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:29.222195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3f120-9bf7-4c3e-8daa-2f5ece819af0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:29.222484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3f120-9bf7-4c3e-8daa-2f5ece819af0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:29.222761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3f120-9bf7-4c3e-8daa-2f5ece819af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:29.296189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:29.308722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e0e3f120-9bf7-4c3e-8daa-2f5ece819af0 None None] MFA Rules not processed for user `b5a03e5f2dee4bdeac26236d8127588c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:29.310037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e0e3f120-9bf7-4c3e-8daa-2f5ece819af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:29.322925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 701/1400] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:29.367572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc84a4e-b80e-4af5-a817-96224e02cde7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:29.368808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dbc84a4e-b80e-4af5-a817-96224e02cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:29.396028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:29.432231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 700/1401] 10.222.0.20 () {58 vars in 1040 bytes} [Tue Jul 26 07:20:29 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:20:29.442232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3f120-9bf7-4c3e-8daa-2f5ece819af0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:29.452387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3f120-9bf7-4c3e-8daa-2f5ece819af0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:29.492523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc84a4e-b80e-4af5-a817-96224e02cde7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:29.561748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a1224-32b6-40e5-b99d-072eff261e02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:29.562393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a1224-32b6-40e5-b99d-072eff261e02 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:29.562670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a1224-32b6-40e5-b99d-072eff261e02 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:29.562962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a1224-32b6-40e5-b99d-072eff261e02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:29.564688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-858a1224-32b6-40e5-b99d-072eff261e02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:29.567623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:29.615768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80aed3-d9af-497a-bcaa-0ec487336d71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:29.616507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80aed3-d9af-497a-bcaa-0ec487336d71 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:29.616781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80aed3-d9af-497a-bcaa-0ec487336d71 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:29.617057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80aed3-d9af-497a-bcaa-0ec487336d71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:29.618800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ff80aed3-d9af-497a-bcaa-0ec487336d71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:29.638434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:29.658255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a1224-32b6-40e5-b99d-072eff261e02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:29.659882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a1224-32b6-40e5-b99d-072eff261e02 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:29.668707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 701/1402] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:20:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:20:29.724207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80aed3-d9af-497a-bcaa-0ec487336d71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:29.725881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80aed3-d9af-497a-bcaa-0ec487336d71 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:29.746301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 702/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:20:31.852100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293ab7f-ecb7-419e-b746-93b497e27b5f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:31.852643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293ab7f-ecb7-419e-b746-93b497e27b5f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:31.852643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293ab7f-ecb7-419e-b746-93b497e27b5f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:31.857317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 702/1404] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:31.859799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01f82e-18e4-4d37-a93f-1c1e7376d334 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:31.860279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01f82e-18e4-4d37-a93f-1c1e7376d334 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:31.860378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01f82e-18e4-4d37-a93f-1c1e7376d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:31.941433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3b01f82e-18e4-4d37-a93f-1c1e7376d334 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:31.943033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3b01f82e-18e4-4d37-a93f-1c1e7376d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:32.074335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:32.093309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 703/1405] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:32.126861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293ab7f-ecb7-419e-b746-93b497e27b5f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:32.128422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f293ab7f-ecb7-419e-b746-93b497e27b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:32.298591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:32.303850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293ab7f-ecb7-419e-b746-93b497e27b5f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:32.448682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635acbe8-01f2-48bc-9149-c01b689c70f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:32.450640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635acbe8-01f2-48bc-9149-c01b689c70f0 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:32.450918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635acbe8-01f2-48bc-9149-c01b689c70f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:32.451182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635acbe8-01f2-48bc-9149-c01b689c70f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:32.453291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-635acbe8-01f2-48bc-9149-c01b689c70f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:32.560892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635acbe8-01f2-48bc-9149-c01b689c70f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:32.562797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635acbe8-01f2-48bc-9149-c01b689c70f0 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:32.582985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 703/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:34.669455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6e2a5-deca-4930-8670-cc2e92eaabcc None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:34.670024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6e2a5-deca-4930-8670-cc2e92eaabcc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:34.670024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6e2a5-deca-4930-8670-cc2e92eaabcc None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:34.671408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 704/1407] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:34.677946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b02c-93b3-46c0-9955-341790b5c430 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:34.677946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b02c-93b3-46c0-9955-341790b5c430 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:34.677946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b02c-93b3-46c0-9955-341790b5c430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:34.682241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:34.759106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3200b02c-93b3-46c0-9955-341790b5c430 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:34.760664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3200b02c-93b3-46c0-9955-341790b5c430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:34.874730 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 704/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:34.919871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6e2a5-deca-4930-8670-cc2e92eaabcc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:34.921507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-62a6e2a5-deca-4930-8670-cc2e92eaabcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:35.086191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6e2a5-deca-4930-8670-cc2e92eaabcc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:35.169118 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:35.222533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4cc0a-ee3d-454b-83a1-6914d9181944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:35.223185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4cc0a-ee3d-454b-83a1-6914d9181944 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:35.223464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4cc0a-ee3d-454b-83a1-6914d9181944 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:35.223740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4cc0a-ee3d-454b-83a1-6914d9181944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:35.225493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9df4cc0a-ee3d-454b-83a1-6914d9181944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:35.321018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4cc0a-ee3d-454b-83a1-6914d9181944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:35.322687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4cc0a-ee3d-454b-83a1-6914d9181944 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:35.345434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 705/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:44.872877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=64 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:45.339825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=64 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:52.093675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265623a6-d550-4560-8299-77bf85dc34f6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:52.094455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265623a6-d550-4560-8299-77bf85dc34f6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:52.094455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265623a6-d550-4560-8299-77bf85dc34f6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:52.095473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 705/1410] 10.222.0.20 () {54 vars in 918 bytes} [Tue Jul 26 07:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:52.100708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852c8a-64eb-4d69-8085-9ec9e2e30791 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:52.101174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852c8a-64eb-4d69-8085-9ec9e2e30791 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:52.101293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852c8a-64eb-4d69-8085-9ec9e2e30791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:52.180010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6d852c8a-64eb-4d69-8085-9ec9e2e30791 None None] MFA Rules not processed for user `826fd481bf2e40d6917bb604591a75cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:52.181245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6d852c8a-64eb-4d69-8085-9ec9e2e30791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:52.296234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 706/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jul 26 07:20:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:52.311334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46861a46-33e3-4a30-9199-33790fe44912 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:52.311622 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46861a46-33e3-4a30-9199-33790fe44912 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:52.311901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46861a46-33e3-4a30-9199-33790fe44912 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:52.313297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 706/1412] 10.222.0.20 () {54 vars in 918 bytes} [Tue Jul 26 07:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:52.318389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a6cda-d556-4ea7-a796-ed8b160d7eaf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:52.318673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a6cda-d556-4ea7-a796-ed8b160d7eaf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:52.318947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a6cda-d556-4ea7-a796-ed8b160d7eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:52.403267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:52.408206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a74a6cda-d556-4ea7-a796-ed8b160d7eaf None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:52.409892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a74a6cda-d556-4ea7-a796-ed8b160d7eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:52.540914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 707/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jul 26 07:20:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:55.027167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f182e51-b9a3-409c-a470-eb948c7a83d6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:55.027736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f182e51-b9a3-409c-a470-eb948c7a83d6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:55.027736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f182e51-b9a3-409c-a470-eb948c7a83d6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:55.029107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:55.034929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96cf67-cd2c-49a7-a2be-fa12a98e2078 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:55.035400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96cf67-cd2c-49a7-a2be-fa12a98e2078 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:55.035521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96cf67-cd2c-49a7-a2be-fa12a98e2078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:55.106821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-be96cf67-cd2c-49a7-a2be-fa12a98e2078 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:55.108090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-be96cf67-cd2c-49a7-a2be-fa12a98e2078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:55.170000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:55.225021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:55.271125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f182e51-b9a3-409c-a470-eb948c7a83d6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:55.272827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1f182e51-b9a3-409c-a470-eb948c7a83d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:55.436810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f182e51-b9a3-409c-a470-eb948c7a83d6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:55.515632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:55.558210 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799040e5-acaf-477a-9847-4a97c58fa0c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:55.558985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799040e5-acaf-477a-9847-4a97c58fa0c3 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:55.559258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799040e5-acaf-477a-9847-4a97c58fa0c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:55.559537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799040e5-acaf-477a-9847-4a97c58fa0c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:55.561228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-799040e5-acaf-477a-9847-4a97c58fa0c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:55.654536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799040e5-acaf-477a-9847-4a97c58fa0c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:55.656182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799040e5-acaf-477a-9847-4a97c58fa0c3 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:55.674806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 708/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:56.578986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263aa52-8ce3-4f0d-a246-a91907e71d50 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:56.579605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263aa52-8ce3-4f0d-a246-a91907e71d50 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:56.579605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263aa52-8ce3-4f0d-a246-a91907e71d50 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:56.580969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:56.586515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53732af0-aa01-4d20-a742-5b597d076f2c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:56.586973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53732af0-aa01-4d20-a742-5b597d076f2c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:56.587091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53732af0-aa01-4d20-a742-5b597d076f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:56.672378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-53732af0-aa01-4d20-a742-5b597d076f2c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:56.673678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-53732af0-aa01-4d20-a742-5b597d076f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:56.704451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:56.783364 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:56.932623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263aa52-8ce3-4f0d-a246-a91907e71d50 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:56.934354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c263aa52-8ce3-4f0d-a246-a91907e71d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:57.092302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263aa52-8ce3-4f0d-a246-a91907e71d50 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:57.133711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:57.206486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0a3b-994e-4b53-8cd2-c0f0aaaae579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:57.207113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0a3b-994e-4b53-8cd2-c0f0aaaae579 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:57.207391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0a3b-994e-4b53-8cd2-c0f0aaaae579 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:57.207657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0a3b-994e-4b53-8cd2-c0f0aaaae579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:57.209272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e7db0a3b-994e-4b53-8cd2-c0f0aaaae579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:57.308654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0a3b-994e-4b53-8cd2-c0f0aaaae579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:57.310345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0a3b-994e-4b53-8cd2-c0f0aaaae579 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:57.329810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 710/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:58.206856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b4fc-ced7-45ce-8f1a-8057ca91e13e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:58.207465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b4fc-ced7-45ce-8f1a-8057ca91e13e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:58.207465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b4fc-ced7-45ce-8f1a-8057ca91e13e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:58.208778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:58.215382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1448db6-94a9-4e0f-9a81-e200f340618f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:58.215885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1448db6-94a9-4e0f-9a81-e200f340618f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:58.215994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1448db6-94a9-4e0f-9a81-e200f340618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:58.279306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:58.311801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b1448db6-94a9-4e0f-9a81-e200f340618f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:58.313062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b1448db6-94a9-4e0f-9a81-e200f340618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:58.416629 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:20:58.569053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b4fc-ced7-45ce-8f1a-8057ca91e13e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:20:58.570732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-48a0b4fc-ced7-45ce-8f1a-8057ca91e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:58.728414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b4fc-ced7-45ce-8f1a-8057ca91e13e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:20:58.741597 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:58.848262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990132f-7da5-4552-a96d-9c68d7a08f4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:20:58.848801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990132f-7da5-4552-a96d-9c68d7a08f4e service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:58.849075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990132f-7da5-4552-a96d-9c68d7a08f4e service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:58.849378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990132f-7da5-4552-a96d-9c68d7a08f4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:58.851059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1990132f-7da5-4552-a96d-9c68d7a08f4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:20:58.945121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990132f-7da5-4552-a96d-9c68d7a08f4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:20:58.946800 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990132f-7da5-4552-a96d-9c68d7a08f4e service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:20:58.966151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 711/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:20:59.837017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606594-dc39-44fa-a202-16d836ee20de None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:59.838128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606594-dc39-44fa-a202-16d836ee20de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:59.838128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606594-dc39-44fa-a202-16d836ee20de None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:59.840156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:20:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:20:59.845588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308c63-5a86-4200-b4ba-fb50bd8e44ea None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:20:59.846059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308c63-5a86-4200-b4ba-fb50bd8e44ea None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:20:59.846157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308c63-5a86-4200-b4ba-fb50bd8e44ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:20:59.866626 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:20:59.926417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ff308c63-5a86-4200-b4ba-fb50bd8e44ea None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:20:59.927560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ff308c63-5a86-4200-b4ba-fb50bd8e44ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:00.049235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:00.198806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c606594-dc39-44fa-a202-16d836ee20de None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:00.200474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9c606594-dc39-44fa-a202-16d836ee20de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:00.316238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:00.353963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c606594-dc39-44fa-a202-16d836ee20de None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:00.479678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6e0d9-4b29-4a32-958f-3dd423942404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:00.480415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e0d9-4b29-4a32-958f-3dd423942404 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:00.480725 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e0d9-4b29-4a32-958f-3dd423942404 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:00.481021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e0d9-4b29-4a32-958f-3dd423942404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:00.483508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-30b6e0d9-4b29-4a32-958f-3dd423942404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:00.569477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:00.583282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6e0d9-4b29-4a32-958f-3dd423942404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:00.585253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6e0d9-4b29-4a32-958f-3dd423942404 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:00.603601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 713/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:01.469472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74d41a-edf8-499b-9985-ed470dc87196 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:01.470352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74d41a-edf8-499b-9985-ed470dc87196 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:01.470352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74d41a-edf8-499b-9985-ed470dc87196 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:01.472481 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:21:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:01.480964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19166f03-cbf2-47d5-abc9-fc00a9cae357 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:01.481781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19166f03-cbf2-47d5-abc9-fc00a9cae357 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:01.482004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19166f03-cbf2-47d5-abc9-fc00a9cae357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:01.693248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-19166f03-cbf2-47d5-abc9-fc00a9cae357 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:01.694523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-19166f03-cbf2-47d5-abc9-fc00a9cae357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:01.793624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:01.944239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74d41a-edf8-499b-9985-ed470dc87196 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:01.946582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9d74d41a-edf8-499b-9985-ed470dc87196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:02.036711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:02.105484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74d41a-edf8-499b-9985-ed470dc87196 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:02.239588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5d75-59c6-4e5c-8d3d-3b2226851e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:02.240224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5d75-59c6-4e5c-8d3d-3b2226851e60 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:02.240502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5d75-59c6-4e5c-8d3d-3b2226851e60 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:02.240775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5d75-59c6-4e5c-8d3d-3b2226851e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:02.242476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d55b5d75-59c6-4e5c-8d3d-3b2226851e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:02.298067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:02.342051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b5d75-59c6-4e5c-8d3d-3b2226851e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:02.343678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b5d75-59c6-4e5c-8d3d-3b2226851e60 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:02.362867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 714/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:03.168969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237d07-ee1b-4cc3-b70f-35b70bd0a2da None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:03.169660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237d07-ee1b-4cc3-b70f-35b70bd0a2da None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:03.169783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237d07-ee1b-4cc3-b70f-35b70bd0a2da None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:03.171193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:03.176470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219359f-fa2c-4dc2-b30b-5cc00be4e50c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:03.176896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219359f-fa2c-4dc2-b30b-5cc00be4e50c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:03.177057 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219359f-fa2c-4dc2-b30b-5cc00be4e50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:03.266693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3219359f-fa2c-4dc2-b30b-5cc00be4e50c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:03.269337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3219359f-fa2c-4dc2-b30b-5cc00be4e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:03.373897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:03.522322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237d07-ee1b-4cc3-b70f-35b70bd0a2da None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:03.523816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-53237d07-ee1b-4cc3-b70f-35b70bd0a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:03.575812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:03.678083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237d07-ee1b-4cc3-b70f-35b70bd0a2da None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:03.796607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1610-4fbb-43e9-96cf-399fcaa7b5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:03.797135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1610-4fbb-43e9-96cf-399fcaa7b5cb service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:03.797439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1610-4fbb-43e9-96cf-399fcaa7b5cb service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:03.797706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1610-4fbb-43e9-96cf-399fcaa7b5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:03.799343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f05f1610-4fbb-43e9-96cf-399fcaa7b5cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:03.806503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:03.895248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1610-4fbb-43e9-96cf-399fcaa7b5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:03.896850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1610-4fbb-43e9-96cf-399fcaa7b5cb service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:03.916097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 716/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:04.711802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab66b3-94f3-41e3-bf1d-a01881bb779a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:04.712393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab66b3-94f3-41e3-bf1d-a01881bb779a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:04.712393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab66b3-94f3-41e3-bf1d-a01881bb779a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:04.713802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:04.719061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1df75-0aec-442d-8801-2711c3d4b37b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:04.719543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1df75-0aec-442d-8801-2711c3d4b37b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:04.719543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1df75-0aec-442d-8801-2711c3d4b37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:04.800013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3eb1df75-0aec-442d-8801-2711c3d4b37b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:04.801097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3eb1df75-0aec-442d-8801-2711c3d4b37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:04.871793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:04.902502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:21:05.051520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab66b3-94f3-41e3-bf1d-a01881bb779a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:05.052936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5bab66b3-94f3-41e3-bf1d-a01881bb779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:05.071070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:05.206278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab66b3-94f3-41e3-bf1d-a01881bb779a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:05.299034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:05.326407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb58571-0716-4fc1-836b-8119d2a3c798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:05.326944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb58571-0716-4fc1-836b-8119d2a3c798 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:05.327183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb58571-0716-4fc1-836b-8119d2a3c798 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:05.327473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb58571-0716-4fc1-836b-8119d2a3c798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:05.329110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1fb58571-0716-4fc1-836b-8119d2a3c798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:05.436215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb58571-0716-4fc1-836b-8119d2a3c798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:05.437926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb58571-0716-4fc1-836b-8119d2a3c798 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:05.458440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 717/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:06.267697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b272e3-6588-4f79-9084-c1bd630b4d5a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:06.268269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b272e3-6588-4f79-9084-c1bd630b4d5a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:06.268269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b272e3-6588-4f79-9084-c1bd630b4d5a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:06.270438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:21:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:06.278728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6f5b5-76dd-4c91-b2d1-0777691f2ff0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:06.279163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6f5b5-76dd-4c91-b2d1-0777691f2ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:06.279333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6f5b5-76dd-4c91-b2d1-0777691f2ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:06.362323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f4d6f5b5-76dd-4c91-b2d1-0777691f2ff0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:06.363561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f4d6f5b5-76dd-4c91-b2d1-0777691f2ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:06.410342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:06.470511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:06.632765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b272e3-6588-4f79-9084-c1bd630b4d5a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:06.634337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-87b272e3-6588-4f79-9084-c1bd630b4d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:06.799139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b272e3-6588-4f79-9084-c1bd630b4d5a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:06.860296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:06.924820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b71ff-7e26-424f-bae5-2e02bb67a4a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:06.925480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b71ff-7e26-424f-bae5-2e02bb67a4a8 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:06.925789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b71ff-7e26-424f-bae5-2e02bb67a4a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:06.926052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b71ff-7e26-424f-bae5-2e02bb67a4a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:06.927710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5c7b71ff-7e26-424f-bae5-2e02bb67a4a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:07.026387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b71ff-7e26-424f-bae5-2e02bb67a4a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:07.028002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b71ff-7e26-424f-bae5-2e02bb67a4a8 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:07.046414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 719/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:07.840417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77489c3f-a981-4507-9c62-53adf4b93224 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:07.840944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77489c3f-a981-4507-9c62-53adf4b93224 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:07.840944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77489c3f-a981-4507-9c62-53adf4b93224 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:07.842366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:07.850715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62240b8-75ea-4bc6-90b0-990666e29e09 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:07.851193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62240b8-75ea-4bc6-90b0-990666e29e09 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:07.851370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62240b8-75ea-4bc6-90b0-990666e29e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:07.930918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d62240b8-75ea-4bc6-90b0-990666e29e09 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:07.932052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d62240b8-75ea-4bc6-90b0-990666e29e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:07.934173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:08.041226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:08.194009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77489c3f-a981-4507-9c62-53adf4b93224 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:08.195553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-77489c3f-a981-4507-9c62-53adf4b93224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:08.352489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77489c3f-a981-4507-9c62-53adf4b93224 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:08.385984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:08.485813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092b2c9-357b-416c-8a38-837bab802f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:08.486338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092b2c9-357b-416c-8a38-837bab802f83 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:08.486611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092b2c9-357b-416c-8a38-837bab802f83 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:08.486842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092b2c9-357b-416c-8a38-837bab802f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:08.488499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9092b2c9-357b-416c-8a38-837bab802f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:08.589479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092b2c9-357b-416c-8a38-837bab802f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:08.591133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092b2c9-357b-416c-8a38-837bab802f83 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:08.610219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 720/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:21:10.502362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784354c4-6bb1-4a9d-bdf2-5a8a1fa6485b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:10.502980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784354c4-6bb1-4a9d-bdf2-5a8a1fa6485b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:10.502980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784354c4-6bb1-4a9d-bdf2-5a8a1fa6485b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:10.505035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:10.511555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88668c15-dac0-42a5-abe8-4208cb78635e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:10.512049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88668c15-dac0-42a5-abe8-4208cb78635e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:10.512154 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88668c15-dac0-42a5-abe8-4208cb78635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:10.562384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:10.591179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-88668c15-dac0-42a5-abe8-4208cb78635e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:10.592420 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-88668c15-dac0-42a5-abe8-4208cb78635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:10.695277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:10.735691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784354c4-6bb1-4a9d-bdf2-5a8a1fa6485b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:10.737286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-784354c4-6bb1-4a9d-bdf2-5a8a1fa6485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:10.861148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784354c4-6bb1-4a9d-bdf2-5a8a1fa6485b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:10.895902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:10.941618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1cdde-fc34-4edc-9d40-1c7cbf14265a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:10.942254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1cdde-fc34-4edc-9d40-1c7cbf14265a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:10.942529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1cdde-fc34-4edc-9d40-1c7cbf14265a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:10.942793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1cdde-fc34-4edc-9d40-1c7cbf14265a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:10.944432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4fd1cdde-fc34-4edc-9d40-1c7cbf14265a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:11.059299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1cdde-fc34-4edc-9d40-1c7cbf14265a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:11.060735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1cdde-fc34-4edc-9d40-1c7cbf14265a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:11.079473 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 722/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:21:13.216136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53662fc9-aa12-4ae0-91a3-391a218fb09c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:13.216724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53662fc9-aa12-4ae0-91a3-391a218fb09c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:13.216724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53662fc9-aa12-4ae0-91a3-391a218fb09c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:13.218103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:13.223423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a0720-df8c-41d4-a38b-8ec4ca78cb1b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:13.223875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a0720-df8c-41d4-a38b-8ec4ca78cb1b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:13.223974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a0720-df8c-41d4-a38b-8ec4ca78cb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:13.294447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9d6a0720-df8c-41d4-a38b-8ec4ca78cb1b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:13.295703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9d6a0720-df8c-41d4-a38b-8ec4ca78cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:13.309100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:13.397783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:13.436804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53662fc9-aa12-4ae0-91a3-391a218fb09c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:13.438415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-53662fc9-aa12-4ae0-91a3-391a218fb09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:13.548645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53662fc9-aa12-4ae0-91a3-391a218fb09c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:13.561956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:13.627644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44f00a-eef7-4fd7-89a3-1dc4c6df15e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:13.628271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44f00a-eef7-4fd7-89a3-1dc4c6df15e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:13.628546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44f00a-eef7-4fd7-89a3-1dc4c6df15e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:13.628857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44f00a-eef7-4fd7-89a3-1dc4c6df15e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:13.630583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aa44f00a-eef7-4fd7-89a3-1dc4c6df15e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:13.750342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44f00a-eef7-4fd7-89a3-1dc4c6df15e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:13.751789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44f00a-eef7-4fd7-89a3-1dc4c6df15e8 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:13.770323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 723/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:16.093150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb402e2-bc5b-4f4a-a6b4-17001ef89969 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:16.093796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb402e2-bc5b-4f4a-a6b4-17001ef89969 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:16.093796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb402e2-bc5b-4f4a-a6b4-17001ef89969 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:16.095122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:16.100710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40c9b-f3bd-45b7-bc72-8808579c1f89 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:16.101186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40c9b-f3bd-45b7-bc72-8808579c1f89 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:16.101305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40c9b-f3bd-45b7-bc72-8808579c1f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:16.157675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:16.178012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f0c40c9b-f3bd-45b7-bc72-8808579c1f89 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:16.179281 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f0c40c9b-f3bd-45b7-bc72-8808579c1f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:16.290177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:16.329161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb402e2-bc5b-4f4a-a6b4-17001ef89969 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:16.330780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abb402e2-bc5b-4f4a-a6b4-17001ef89969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:16.443460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb402e2-bc5b-4f4a-a6b4-17001ef89969 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:16.485386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:16.529012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6358b-9af2-407a-a499-006dcebe66df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:16.529677 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6358b-9af2-407a-a499-006dcebe66df service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:16.529956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6358b-9af2-407a-a499-006dcebe66df service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:16.530229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6358b-9af2-407a-a499-006dcebe66df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:16.531903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7bb6358b-9af2-407a-a499-006dcebe66df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:16.653745 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6358b-9af2-407a-a499-006dcebe66df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:16.655210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6358b-9af2-407a-a499-006dcebe66df service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:16.673985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 725/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:18.793658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f0583-41dd-45c3-b4fa-3543fb6d6d83 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:18.794233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f0583-41dd-45c3-b4fa-3543fb6d6d83 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:18.794233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f0583-41dd-45c3-b4fa-3543fb6d6d83 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:18.795641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:18.801815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a1b0-f4d1-42b7-8c1e-44af99f7ff78 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:18.802296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a1b0-f4d1-42b7-8c1e-44af99f7ff78 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:18.802390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a1b0-f4d1-42b7-8c1e-44af99f7ff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:18.874074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1d17a1b0-f4d1-42b7-8c1e-44af99f7ff78 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:18.875319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1d17a1b0-f4d1-42b7-8c1e-44af99f7ff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:18.897126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:18.977727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:19.020290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f0583-41dd-45c3-b4fa-3543fb6d6d83 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:19.021956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-084f0583-41dd-45c3-b4fa-3543fb6d6d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:19.131329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f0583-41dd-45c3-b4fa-3543fb6d6d83 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:19.153228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:19.209301 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aef022-99f5-49d1-9607-843fa25e9681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:19.210368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aef022-99f5-49d1-9607-843fa25e9681 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:19.210644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aef022-99f5-49d1-9607-843fa25e9681 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:19.210913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aef022-99f5-49d1-9607-843fa25e9681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:19.212547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e7aef022-99f5-49d1-9607-843fa25e9681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:19.328086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aef022-99f5-49d1-9607-843fa25e9681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:19.329654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aef022-99f5-49d1-9607-843fa25e9681 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:19.349292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 726/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:21.432126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c427c-7769-4bf5-a8ae-b54bbb0f1fc3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:21.432746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c427c-7769-4bf5-a8ae-b54bbb0f1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:21.432746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c427c-7769-4bf5-a8ae-b54bbb0f1fc3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:21.434126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:21.440061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a581d0d-444b-46d3-bb4c-bc8690bd1031 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:21.440627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a581d0d-444b-46d3-bb4c-bc8690bd1031 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:21.440627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a581d0d-444b-46d3-bb4c-bc8690bd1031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:21.635094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:21.638351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8a581d0d-444b-46d3-bb4c-bc8690bd1031 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:21.640148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8a581d0d-444b-46d3-bb4c-bc8690bd1031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:21.742212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:21.780777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c427c-7769-4bf5-a8ae-b54bbb0f1fc3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:21.782581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1a2c427c-7769-4bf5-a8ae-b54bbb0f1fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:21.891992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c427c-7769-4bf5-a8ae-b54bbb0f1fc3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:21.943025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:21.970380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc276d-911d-4a54-9cc0-b1cc7c4fae55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:21.971022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc276d-911d-4a54-9cc0-b1cc7c4fae55 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:21.971296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc276d-911d-4a54-9cc0-b1cc7c4fae55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:21.971565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc276d-911d-4a54-9cc0-b1cc7c4fae55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:21.973278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2bdc276d-911d-4a54-9cc0-b1cc7c4fae55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:22.088554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc276d-911d-4a54-9cc0-b1cc7c4fae55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:22.090047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc276d-911d-4a54-9cc0-b1cc7c4fae55 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:22.108920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 728/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:24.171873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa816f-44c3-4f31-a106-5317585d26dc None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:24.172485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa816f-44c3-4f31-a106-5317585d26dc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:24.172485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa816f-44c3-4f31-a106-5317585d26dc None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:24.173866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:24.179611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ff56c-3448-4811-8ae2-7663b85f6eac None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:24.180052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ff56c-3448-4811-8ae2-7663b85f6eac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:24.180162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ff56c-3448-4811-8ae2-7663b85f6eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:24.255381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-535ff56c-3448-4811-8ae2-7663b85f6eac None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:24.256658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-535ff56c-3448-4811-8ae2-7663b85f6eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:24.290011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:24.366757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:24.405729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa816f-44c3-4f31-a106-5317585d26dc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:24.407413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8baa816f-44c3-4f31-a106-5317585d26dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:24.531225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa816f-44c3-4f31-a106-5317585d26dc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:24.562076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:24.611999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bb534-33cc-4f01-8e04-6db81fac0878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:24.612642 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bb534-33cc-4f01-8e04-6db81fac0878 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:24.612922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bb534-33cc-4f01-8e04-6db81fac0878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:24.613166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bb534-33cc-4f01-8e04-6db81fac0878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:24.614957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-786bb534-33cc-4f01-8e04-6db81fac0878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:24.738892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bb534-33cc-4f01-8e04-6db81fac0878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:24.740359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bb534-33cc-4f01-8e04-6db81fac0878 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:24.760914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 729/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:26.830875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642de2e-d1ce-454f-b9ad-2b291e1b15eb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:26.831456 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642de2e-d1ce-454f-b9ad-2b291e1b15eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:26.831456 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642de2e-d1ce-454f-b9ad-2b291e1b15eb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:26.832797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:26.839031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fc50-0100-45fd-83ee-0ce6d797fb23 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:26.839729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fc50-0100-45fd-83ee-0ce6d797fb23 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:26.839729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fc50-0100-45fd-83ee-0ce6d797fb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:26.909538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1a07fc50-0100-45fd-83ee-0ce6d797fb23 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:26.910732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1a07fc50-0100-45fd-83ee-0ce6d797fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:26.920901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:27.014771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:27.052025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642de2e-d1ce-454f-b9ad-2b291e1b15eb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:27.053626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2642de2e-d1ce-454f-b9ad-2b291e1b15eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:27.162730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642de2e-d1ce-454f-b9ad-2b291e1b15eb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:27.221022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:27.241904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185223a-5b3d-43fe-8800-2cd26ef64089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:27.242546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185223a-5b3d-43fe-8800-2cd26ef64089 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:27.242824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185223a-5b3d-43fe-8800-2cd26ef64089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:27.243095 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185223a-5b3d-43fe-8800-2cd26ef64089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:27.244779 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b185223a-5b3d-43fe-8800-2cd26ef64089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:27.360268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185223a-5b3d-43fe-8800-2cd26ef64089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:27.361753 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185223a-5b3d-43fe-8800-2cd26ef64089 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:27.380604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 731/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:29.445970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0712-6208-45fe-8ad2-c8cec47ff05e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:29.446613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0712-6208-45fe-8ad2-c8cec47ff05e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:29.446613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0712-6208-45fe-8ad2-c8cec47ff05e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:29.447952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:29.453778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b0fa-8f44-4cba-ac4b-06d6fb9b70f8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:29.454215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b0fa-8f44-4cba-ac4b-06d6fb9b70f8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:29.454318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b0fa-8f44-4cba-ac4b-06d6fb9b70f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:29.525829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7375b0fa-8f44-4cba-ac4b-06d6fb9b70f8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:29.527082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7375b0fa-8f44-4cba-ac4b-06d6fb9b70f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:29.568284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:29.628483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:29.665543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0712-6208-45fe-8ad2-c8cec47ff05e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:29.667116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f57f0712-6208-45fe-8ad2-c8cec47ff05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:29.780322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0712-6208-45fe-8ad2-c8cec47ff05e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:29.818982 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:29.857048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a770f-0368-4e82-83f6-28ab436a027d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:29.857677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a770f-0368-4e82-83f6-28ab436a027d service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:29.857975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a770f-0368-4e82-83f6-28ab436a027d service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:29.858254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a770f-0368-4e82-83f6-28ab436a027d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:29.859888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-763a770f-0368-4e82-83f6-28ab436a027d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:29.973896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a770f-0368-4e82-83f6-28ab436a027d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:29.975399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a770f-0368-4e82-83f6-28ab436a027d service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:29.994646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 732/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:32.047011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8df46-5cd4-46be-bf51-72df996b9848 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:32.047631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8df46-5cd4-46be-bf51-72df996b9848 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:32.047631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8df46-5cd4-46be-bf51-72df996b9848 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:32.048929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:32.054778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e2d1-fc3b-4004-adff-caface4709e8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:32.055198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e2d1-fc3b-4004-adff-caface4709e8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:32.055315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e2d1-fc3b-4004-adff-caface4709e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:32.124322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1527e2d1-fc3b-4004-adff-caface4709e8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:32.125570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1527e2d1-fc3b-4004-adff-caface4709e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:32.144009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:32.227308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:32.263858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8df46-5cd4-46be-bf51-72df996b9848 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:32.265505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-29f8df46-5cd4-46be-bf51-72df996b9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:32.375022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8df46-5cd4-46be-bf51-72df996b9848 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:32.451172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:32.459043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7fc37-d8be-4793-83ef-98ed46c0751b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:32.460050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fc37-d8be-4793-83ef-98ed46c0751b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:32.460325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fc37-d8be-4793-83ef-98ed46c0751b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:32.460591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fc37-d8be-4793-83ef-98ed46c0751b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:32.462315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-02d7fc37-d8be-4793-83ef-98ed46c0751b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:32.583209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7fc37-d8be-4793-83ef-98ed46c0751b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:32.585067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7fc37-d8be-4793-83ef-98ed46c0751b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:32.606176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 734/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:34.612448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eff40-b788-4bfe-9e2d-a93ee58deba8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:34.613120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eff40-b788-4bfe-9e2d-a93ee58deba8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:34.613120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eff40-b788-4bfe-9e2d-a93ee58deba8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:34.614373 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:34.619878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7b35-9db5-4dcc-9e49-a8ca69815bd7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:34.620379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7b35-9db5-4dcc-9e49-a8ca69815bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:34.620492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7b35-9db5-4dcc-9e49-a8ca69815bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:34.691417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-807c7b35-9db5-4dcc-9e49-a8ca69815bd7 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:34.692668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-807c7b35-9db5-4dcc-9e49-a8ca69815bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:34.745835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:34.807533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:34.844433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eff40-b788-4bfe-9e2d-a93ee58deba8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:34.846045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cb6eff40-b788-4bfe-9e2d-a93ee58deba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:34.955150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eff40-b788-4bfe-9e2d-a93ee58deba8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:35.005069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:35.032523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ada6d9-8d5a-4c5d-b40d-9f76fc1c23a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:35.033152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ada6d9-8d5a-4c5d-b40d-9f76fc1c23a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:35.033461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ada6d9-8d5a-4c5d-b40d-9f76fc1c23a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:35.033732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ada6d9-8d5a-4c5d-b40d-9f76fc1c23a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:35.035380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-94ada6d9-8d5a-4c5d-b40d-9f76fc1c23a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:35.149863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ada6d9-8d5a-4c5d-b40d-9f76fc1c23a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:35.151263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ada6d9-8d5a-4c5d-b40d-9f76fc1c23a0 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:35.170116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 735/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:44.805574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=22 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:45.167771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=66 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:54.457909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9310c-b480-4a76-962b-017e399fb1ff None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:54.458592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9310c-b480-4a76-962b-017e399fb1ff None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:54.458592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9310c-b480-4a76-962b-017e399fb1ff None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:54.460219 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 736/1471] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:54.466170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df973-d23f-40d5-a04c-e208e4d6726f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:54.466744 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df973-d23f-40d5-a04c-e208e4d6726f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:54.466744 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df973-d23f-40d5-a04c-e208e4d6726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:54.537552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-874df973-d23f-40d5-a04c-e208e4d6726f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:54.538802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-874df973-d23f-40d5-a04c-e208e4d6726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:54.642334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 736/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:54.731273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cccad-fe7e-460b-844a-4edaf171d5b8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:54.731555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cccad-fe7e-460b-844a-4edaf171d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:54.731831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cccad-fe7e-460b-844a-4edaf171d5b8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:54.733209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 737/1473] 10.222.0.20 () {54 vars in 966 bytes} [Tue Jul 26 07:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:54.738381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51769ef8-f88f-4a7f-ba35-715f028366bb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:54.738654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51769ef8-f88f-4a7f-ba35-715f028366bb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:54.738931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51769ef8-f88f-4a7f-ba35-715f028366bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:54.819100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-51769ef8-f88f-4a7f-ba35-715f028366bb None None] MFA Rules not processed for user `2ecb8054ea4249d18903b5998fa753d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:54.820367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-51769ef8-f88f-4a7f-ba35-715f028366bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:54.841887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:54.898907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 737/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Tue Jul 26 07:21:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:21:54.906926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cccad-fe7e-460b-844a-4edaf171d5b8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:54.908491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-362cccad-fe7e-460b-844a-4edaf171d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:55.018025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cccad-fe7e-460b-844a-4edaf171d5b8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:55.094683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a30b11-5764-472e-a659-7d0f2668a32a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb8054ea4249d18903b5998fa753d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:55.095317 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30b11-5764-472e-a659-7d0f2668a32a service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:55.095590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30b11-5764-472e-a659-7d0f2668a32a service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:55.095853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30b11-5764-472e-a659-7d0f2668a32a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:55.097513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c3a30b11-5764-472e-a659-7d0f2668a32a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:55.153383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:55.215540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30b11-5764-472e-a659-7d0f2668a32a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:55.216993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30b11-5764-472e-a659-7d0f2668a32a service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:55.236895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 738/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:21:57.379269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7746d2e-83c2-4e25-9c5b-61b0439e6f01 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:57.379829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7746d2e-83c2-4e25-9c5b-61b0439e6f01 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:57.379829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7746d2e-83c2-4e25-9c5b-61b0439e6f01 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:57.381173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 738/1476] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:57.387591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20fb7-a662-473e-95b6-bf20460ab694 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:57.388090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20fb7-a662-473e-95b6-bf20460ab694 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:57.388090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20fb7-a662-473e-95b6-bf20460ab694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:57.462162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-aec20fb7-a662-473e-95b6-bf20460ab694 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:57.463397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-aec20fb7-a662-473e-95b6-bf20460ab694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:57.566412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 739/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:21:57.590544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7746d2e-83c2-4e25-9c5b-61b0439e6f01 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:21:57.592131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c7746d2e-83c2-4e25-9c5b-61b0439e6f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:21:57.730875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7746d2e-83c2-4e25-9c5b-61b0439e6f01 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:21:57.780977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:21:57.827444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368daa20-06b5-4d87-8db8-5dad86122da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:21:57.828076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368daa20-06b5-4d87-8db8-5dad86122da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:57.828353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368daa20-06b5-4d87-8db8-5dad86122da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:57.828625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368daa20-06b5-4d87-8db8-5dad86122da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:57.829356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368daa20-06b5-4d87-8db8-5dad86122da8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:21:57.831125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING py.warnings [None req-368daa20-06b5-4d87-8db8-5dad86122da8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:21:57.831125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: warnings.warn(msg) Jul 26 07:21:57.831125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: Jul 26 07:21:57.832263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368daa20-06b5-4d87-8db8-5dad86122da8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:21:57.851675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 739/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 26 07:21:57 2022] GET /identity/v3/projects => generated 2553 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:21:59.877301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a70f7-0f61-4b30-8dcd-4cc68bac96bd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:59.877915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a70f7-0f61-4b30-8dcd-4cc68bac96bd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:59.877915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a70f7-0f61-4b30-8dcd-4cc68bac96bd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:59.879243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 740/1479] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:21:59.884805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fedda-cb31-43d6-85b7-4b2844ab7aed None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:21:59.885402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fedda-cb31-43d6-85b7-4b2844ab7aed None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:21:59.885402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fedda-cb31-43d6-85b7-4b2844ab7aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:21:59.958642 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3a3fedda-cb31-43d6-85b7-4b2844ab7aed None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:21:59.960245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3a3fedda-cb31-43d6-85b7-4b2844ab7aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:00.061865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 740/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:22:00.109093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a70f7-0f61-4b30-8dcd-4cc68bac96bd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:22:00.110799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-db9a70f7-0f61-4b30-8dcd-4cc68bac96bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:00.121814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:00.266614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a70f7-0f61-4b30-8dcd-4cc68bac96bd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:22:00.351261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:00.389250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c3ff-e95e-45a8-8ffd-d0c43fc8cea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:22:00.389909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c3ff-e95e-45a8-8ffd-d0c43fc8cea6 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:00.390186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c3ff-e95e-45a8-8ffd-d0c43fc8cea6 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:00.390458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c3ff-e95e-45a8-8ffd-d0c43fc8cea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:00.392101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7990c3ff-e95e-45a8-8ffd-d0c43fc8cea6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:00.484339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990c3ff-e95e-45a8-8ffd-d0c43fc8cea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:22:00.485974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990c3ff-e95e-45a8-8ffd-d0c43fc8cea6 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:22:00.505279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 741/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:22:02.670614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b866e12-b485-455c-8621-79734f77533f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:02.671174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b866e12-b485-455c-8621-79734f77533f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:02.671174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b866e12-b485-455c-8621-79734f77533f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:02.672566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 741/1482] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:22:02.677990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f328d-3600-44a4-8802-40a7fc45bd64 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:02.678415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f328d-3600-44a4-8802-40a7fc45bd64 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:02.678507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f328d-3600-44a4-8802-40a7fc45bd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:02.753446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-664f328d-3600-44a4-8802-40a7fc45bd64 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:22:02.754654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-664f328d-3600-44a4-8802-40a7fc45bd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:02.802572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:02.856734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 742/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:22:02.892613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b866e12-b485-455c-8621-79734f77533f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:22:02.894197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b866e12-b485-455c-8621-79734f77533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:02.920092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:03.010471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b866e12-b485-455c-8621-79734f77533f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:22:03.088068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48289cab-1ae9-41f9-8f78-bbc51906d9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:22:03.088692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48289cab-1ae9-41f9-8f78-bbc51906d9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:03.088967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48289cab-1ae9-41f9-8f78-bbc51906d9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:03.089303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48289cab-1ae9-41f9-8f78-bbc51906d9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:03.090929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-48289cab-1ae9-41f9-8f78-bbc51906d9a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:03.167694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:03.204469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48289cab-1ae9-41f9-8f78-bbc51906d9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:22:03.205981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48289cab-1ae9-41f9-8f78-bbc51906d9a7 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:22:03.225346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 742/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:22:05.304575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4c950-be76-41a2-9687-15398e891db6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:05.305219 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4c950-be76-41a2-9687-15398e891db6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:05.305219 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4c950-be76-41a2-9687-15398e891db6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:05.306516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 743/1485] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:22:05.312315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b90e-6d1d-4d9d-88c0-a4a8a8c9ea7c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:05.312763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b90e-6d1d-4d9d-88c0-a4a8a8c9ea7c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:05.312873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b90e-6d1d-4d9d-88c0-a4a8a8c9ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:05.385152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-01a3b90e-6d1d-4d9d-88c0-a4a8a8c9ea7c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:22:05.386566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-01a3b90e-6d1d-4d9d-88c0-a4a8a8c9ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:05.490504 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 743/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:22:05.524117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4c950-be76-41a2-9687-15398e891db6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:22:05.525860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b1e4c950-be76-41a2-9687-15398e891db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:05.631997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4c950-be76-41a2-9687-15398e891db6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:22:05.706972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:05.709589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfe1b0-f817-48d0-91ed-d0716c830fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:22:05.710563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfe1b0-f817-48d0-91ed-d0716c830fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:05.710851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfe1b0-f817-48d0-91ed-d0716c830fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:05.711127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfe1b0-f817-48d0-91ed-d0716c830fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:05.713657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2bdfe1b0-f817-48d0-91ed-d0716c830fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:05.832939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfe1b0-f817-48d0-91ed-d0716c830fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:22:05.834691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfe1b0-f817-48d0-91ed-d0716c830fb5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:22:05.853289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 744/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:22:08.037885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bffc7-6e8e-4d6e-8804-85d108dc36d8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:08.038479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bffc7-6e8e-4d6e-8804-85d108dc36d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:08.038479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bffc7-6e8e-4d6e-8804-85d108dc36d8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:08.039805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 744/1488] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:22:08.045507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06d21-eb5e-4974-9223-9a4487a5b2eb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:08.045941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06d21-eb5e-4974-9223-9a4487a5b2eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:08.046116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06d21-eb5e-4974-9223-9a4487a5b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:08.125671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-03a06d21-eb5e-4974-9223-9a4487a5b2eb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:22:08.126922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-03a06d21-eb5e-4974-9223-9a4487a5b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:08.184042 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:08.231288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 745/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:22:08.271834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bffc7-6e8e-4d6e-8804-85d108dc36d8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:22:08.273684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-744bffc7-6e8e-4d6e-8804-85d108dc36d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:08.312353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:08.382673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bffc7-6e8e-4d6e-8804-85d108dc36d8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:22:08.458853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb41240-29c6-4044-bcaa-5bc1a2d6ee81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:22:08.459878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb41240-29c6-4044-bcaa-5bc1a2d6ee81 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:08.460157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb41240-29c6-4044-bcaa-5bc1a2d6ee81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:08.460426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb41240-29c6-4044-bcaa-5bc1a2d6ee81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:08.462147 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4cb41240-29c6-4044-bcaa-5bc1a2d6ee81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:08.544978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:08.576638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb41240-29c6-4044-bcaa-5bc1a2d6ee81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:22:08.578052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb41240-29c6-4044-bcaa-5bc1a2d6ee81 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:22:08.598001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 745/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:22:10.822111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577838-4f91-4a1f-b31f-fe5f8a680871 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:10.822710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577838-4f91-4a1f-b31f-fe5f8a680871 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:10.822710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577838-4f91-4a1f-b31f-fe5f8a680871 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:10.824127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 746/1491] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 26 07:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:22:10.830459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cd357-af12-4a41-9e4a-71863cb6c35c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:10.831133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cd357-af12-4a41-9e4a-71863cb6c35c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:10.831246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cd357-af12-4a41-9e4a-71863cb6c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:10.907601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fa0cd357-af12-4a41-9e4a-71863cb6c35c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:22:10.908729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fa0cd357-af12-4a41-9e4a-71863cb6c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:11.018347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 746/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 26 07:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:22:11.057834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27577838-4f91-4a1f-b31f-fe5f8a680871 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:22:11.059430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-27577838-4f91-4a1f-b31f-fe5f8a680871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:11.173945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27577838-4f91-4a1f-b31f-fe5f8a680871 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:22:11.256183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f06a19-c488-4f02-a34f-ab95b21c1a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:22:11.256822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f06a19-c488-4f02-a34f-ab95b21c1a3a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:22:11.257117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f06a19-c488-4f02-a34f-ab95b21c1a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:22:11.257410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f06a19-c488-4f02-a34f-ab95b21c1a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:22:11.259043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-96f06a19-c488-4f02-a34f-ab95b21c1a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:22:11.269163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:11.374727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f06a19-c488-4f02-a34f-ab95b21c1a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:22:11.376182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f06a19-c488-4f02-a34f-ab95b21c1a3a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:22:11.395725 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 747/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:22:21.016282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=82 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:22:21.393379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=50 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:38.644308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53106db-c19d-4ed0-80a4-a96f9e81ac72 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:38.645089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53106db-c19d-4ed0-80a4-a96f9e81ac72 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:38.645089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53106db-c19d-4ed0-80a4-a96f9e81ac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:38.736496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a53106db-c19d-4ed0-80a4-a96f9e81ac72 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:23:38.737782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a53106db-c19d-4ed0-80a4-a96f9e81ac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:38.850655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 747/1494] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:23:38.859169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5f05c-bd53-4c19-a532-cc11fc5a2950 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:38.859706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5f05c-bd53-4c19-a532-cc11fc5a2950 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:38.859706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5f05c-bd53-4c19-a532-cc11fc5a2950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:38.939566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d2e5f05c-bd53-4c19-a532-cc11fc5a2950 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:23:38.940801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d2e5f05c-bd53-4c19-a532-cc11fc5a2950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:39.041615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 748/1495] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:23:39.046528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53106db-c19d-4ed0-80a4-a96f9e81ac72 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:39.047806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a53106db-c19d-4ed0-80a4-a96f9e81ac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:39.060733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53106db-c19d-4ed0-80a4-a96f9e81ac72 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:39.128690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:39.164981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:39.165653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:39.166039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:39.166308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:39.167011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:23:39.167312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:39.168350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING py.warnings [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:39.168350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: warnings.warn(msg) Jul 26 07:23:39.168350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: Jul 26 07:23:39.169412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:39.181909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 748/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:23:39.190640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5f05c-bd53-4c19-a532-cc11fc5a2950 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:39.200626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5f05c-bd53-4c19-a532-cc11fc5a2950 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:39.264711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:39.303193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:39.303822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:39.304095 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:39.304358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:39.305004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:39.306791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:39.306791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jul 26 07:23:39.306791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: Jul 26 07:23:39.307990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:39.368486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 749/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:23:39 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:23:39.373113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:39.374692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:39.410177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b23c1-4a84-4b42-8372-35a6705c05e4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:39.527448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:39.527971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:39.528233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:39.528508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:39.529332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:39.530230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING py.warnings [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:39.530230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: warnings.warn(msg) Jul 26 07:23:39.530230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: Jul 26 07:23:39.531462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:39.576747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 749/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:23:39 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:23:39.581804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:39.584598 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:39.651289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8e54e-bba0-4140-9e48-7cbe8cd1dfcc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:39.741208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:39.753375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:39.754017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:39.754291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:39.754556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:39.755260 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:39.756281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:39.756281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jul 26 07:23:39.756281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: Jul 26 07:23:39.757169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:39.771687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 750/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:23:39.776122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:39.777791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:39.791791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfd167-9348-4985-8334-e3ac79ac7871 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:39.826245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:39.914268 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52fb1e-54fb-473e-8276-a5b3520bcd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:39.914910 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fb1e-54fb-473e-8276-a5b3520bcd6a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:39.915183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fb1e-54fb-473e-8276-a5b3520bcd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:39.915514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fb1e-54fb-473e-8276-a5b3520bcd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:39.916274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52fb1e-54fb-473e-8276-a5b3520bcd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:39.917358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING py.warnings [None req-2a52fb1e-54fb-473e-8276-a5b3520bcd6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:39.917358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: warnings.warn(msg) Jul 26 07:23:39.917358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: Jul 26 07:23:39.918252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52fb1e-54fb-473e-8276-a5b3520bcd6a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:39.931457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 750/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:23:39.936089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:39.937761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:39.975846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a14e26-d222-4b87-827f-2dec58b25076 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:40.078652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fd92c-d456-435c-a395-cd48e564c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:40.079246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fd92c-d456-435c-a395-cd48e564c46a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:40.079586 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fd92c-d456-435c-a395-cd48e564c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:40.079773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fd92c-d456-435c-a395-cd48e564c46a admin admin] PATH_INFO: `/v3/projects/9108e1ea491d43ddbfffb7dd28a2fee6/users/a1592dbb84074de7adfff50fe094ab3f/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:40.111096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fd92c-d456-435c-a395-cd48e564c46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9108e1ea491d43ddbfffb7dd28a2fee6, user_id=a1592dbb84074de7adfff50fe094ab3f, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:40.112155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-7a3fd92c-d456-435c-a395-cd48e564c46a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:40.112155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jul 26 07:23:40.112155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: Jul 26 07:23:40.114169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fd92c-d456-435c-a395-cd48e564c46a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:40.141934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 751/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:23:39 2022] PUT /identity/v3/projects/9108e1ea491d43ddbfffb7dd28a2fee6/users/a1592dbb84074de7adfff50fe094ab3f/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:23:40.154550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac374-3474-415a-92f5-f54daef02e79 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:40.154853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac374-3474-415a-92f5-f54daef02e79 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:40.155132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac374-3474-415a-92f5-f54daef02e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:40.215317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-259ac374-3474-415a-92f5-f54daef02e79 None None] MFA Rules not processed for user `a1592dbb84074de7adfff50fe094ab3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:23:40.216569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-259ac374-3474-415a-92f5-f54daef02e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:40.296493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 751/1502] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:23:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:23:40.310062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae675d5c-8c62-4bee-8194-0ad9b8d21ed7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:40.310399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae675d5c-8c62-4bee-8194-0ad9b8d21ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:40.310701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae675d5c-8c62-4bee-8194-0ad9b8d21ed7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:40.312349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 752/1503] 10.222.0.20 () {54 vars in 964 bytes} [Tue Jul 26 07:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:23:40.317536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4020-29fb-409d-a391-147cb8b63d5f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:40.317825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4020-29fb-409d-a391-147cb8b63d5f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:40.318127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4020-29fb-409d-a391-147cb8b63d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:40.351155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:40.399189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-41be4020-29fb-409d-a391-147cb8b63d5f None None] MFA Rules not processed for user `59f6195586c7434ab85604181ec2a076`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:23:40.400447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-41be4020-29fb-409d-a391-147cb8b63d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:40.484319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 752/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Jul 26 07:23:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:23:40.492533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae675d5c-8c62-4bee-8194-0ad9b8d21ed7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:40.494253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ae675d5c-8c62-4bee-8194-0ad9b8d21ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:40.549320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:40.605968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae675d5c-8c62-4bee-8194-0ad9b8d21ed7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:40.685654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:40.686272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:40.686543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:40.686806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:40.688469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:40.792147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:40.793619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:40.797114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:40.812186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 753/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:23:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:23:40.861016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc5fca-40ba-44a7-a4cb-d16c04a87f2b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:40.861526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc5fca-40ba-44a7-a4cb-d16c04a87f2b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:40.861637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc5fca-40ba-44a7-a4cb-d16c04a87f2b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:40.862922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 753/1506] 10.222.0.20 () {52 vars in 830 bytes} [Tue Jul 26 07:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:23:40.866828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:40.868105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:40.971146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615b115-5499-42db-a9e1-40ab44af2ae3 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:41.084080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:41.084736 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:41.085017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:41.085308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] PATH_INFO: `/v3/users/a1592dbb84074de7adfff50fe094ab3f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:41.098933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1592dbb84074de7adfff50fe094ab3f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:41.099973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:41.099973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jul 26 07:23:41.099973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: Jul 26 07:23:41.101198 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:41.111589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:41.169957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1592dbb84074de7adfff50fe094ab3f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:41.184630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1592dbb84074de7adfff50fe094ab3f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:41.205020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1592dbb84074de7adfff50fe094ab3f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:41.218388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1592dbb84074de7adfff50fe094ab3f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:41.218878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1592dbb84074de7adfff50fe094ab3f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:41.224933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 754/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:23:40 2022] DELETE /identity/v3/users/a1592dbb84074de7adfff50fe094ab3f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:23:41.229893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4dfaf-e835-4744-96a5-277b722d8f05 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:41.230178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4dfaf-e835-4744-96a5-277b722d8f05 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:41.230454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4dfaf-e835-4744-96a5-277b722d8f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:41.288335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-40f4dfaf-e835-4744-96a5-277b722d8f05 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:23:41.289591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-40f4dfaf-e835-4744-96a5-277b722d8f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:41.373836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:41.388757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 754/1508] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:23:41.399538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:41.400856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:41.521733 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5c99-5e97-4540-841c-2707c37f3c7f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:41.579960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:41.600576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c4fc2-fcae-4678-82f3-fff030ad94c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:41.601208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4fc2-fcae-4678-82f3-fff030ad94c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:41.601516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4fc2-fcae-4678-82f3-fff030ad94c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:41.601788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4fc2-fcae-4678-82f3-fff030ad94c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:41.603574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-773c4fc2-fcae-4678-82f3-fff030ad94c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:41.724228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c4fc2-fcae-4678-82f3-fff030ad94c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:41.725700 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c4fc2-fcae-4678-82f3-fff030ad94c2 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:41.744699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 755/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:23:42.124579 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4dfaf-e835-4744-96a5-277b722d8f05 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:23:42.125988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-40f4dfaf-e835-4744-96a5-277b722d8f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:23:42.138889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4dfaf-e835-4744-96a5-277b722d8f05 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:23:42.243396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:23:42.244097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:23:42.244378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:23:42.244632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] PATH_INFO: `/v3/projects/9108e1ea491d43ddbfffb7dd28a2fee6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:23:42.255530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9108e1ea491d43ddbfffb7dd28a2fee6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:23:42.256866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING py.warnings [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:23:42.256866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: warnings.warn(msg) Jul 26 07:23:42.256866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: Jul 26 07:23:42.257730 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:23:42.335376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9108e1ea491d43ddbfffb7dd28a2fee6', 'request_id': 'req-63590736-703d-4ac5-b5a3-17d230cc569a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:42.346779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9108e1ea491d43ddbfffb7dd28a2fee6', 'request_id': 'req-63590736-703d-4ac5-b5a3-17d230cc569a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:42.354130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9108e1ea491d43ddbfffb7dd28a2fee6', 'request_id': 'req-63590736-703d-4ac5-b5a3-17d230cc569a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:42.389396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] The token cache is being invalidate because project 9108e1ea491d43ddbfffb7dd28a2fee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:23:42.389687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:42.390226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63590736-703d-4ac5-b5a3-17d230cc569a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:23:42.391652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 755/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:23:42 2022] DELETE /identity/v3/projects/9108e1ea491d43ddbfffb7dd28a2fee6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:23:51.742208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=62 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:23:52.386912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:29.031430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4218c-0b4f-4b4f-a79d-b09589920848 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:29.032708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4218c-0b4f-4b4f-a79d-b09589920848 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:29.032708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4218c-0b4f-4b4f-a79d-b09589920848 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:29.033510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:25:29.040852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f640b-0c09-46c4-9540-eab4b05941cd None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:29.041693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f640b-0c09-46c4-9540-eab4b05941cd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:29.041865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f640b-0c09-46c4-9540-eab4b05941cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:29.163086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-196f640b-0c09-46c4-9540-eab4b05941cd None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:29.164417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-196f640b-0c09-46c4-9540-eab4b05941cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:29.296042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:25:29.467321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4218c-0b4f-4b4f-a79d-b09589920848 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:25:29.470782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9be4218c-0b4f-4b4f-a79d-b09589920848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:29.634743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4218c-0b4f-4b4f-a79d-b09589920848 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:25:29.640844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883813ad-9515-4637-8edc-fd4d1379a72f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:25:29.641669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883813ad-9515-4637-8edc-fd4d1379a72f service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:29.642016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883813ad-9515-4637-8edc-fd4d1379a72f service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:29.642325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883813ad-9515-4637-8edc-fd4d1379a72f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:29.651943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883813ad-9515-4637-8edc-fd4d1379a72f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:25:29.653845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883813ad-9515-4637-8edc-fd4d1379a72f service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:25:29.664958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 757/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:25:30.576073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05386a2-d5d2-42e7-8e02-c675a7eee13d None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:30.576814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05386a2-d5d2-42e7-8e02-c675a7eee13d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:30.576814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05386a2-d5d2-42e7-8e02-c675a7eee13d None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:30.578629 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:25:30.585116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f30b07-e956-466d-8c47-1eb365e005e1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:30.586007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f30b07-e956-466d-8c47-1eb365e005e1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:30.586007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f30b07-e956-466d-8c47-1eb365e005e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:30.608568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c3f30b07-e956-466d-8c47-1eb365e005e1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:30.610924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c3f30b07-e956-466d-8c47-1eb365e005e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:30.625007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:25:30.740027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a54af-13a9-4b18-86b5-307f5d86ba3a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:30.740528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a54af-13a9-4b18-86b5-307f5d86ba3a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:30.740940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a54af-13a9-4b18-86b5-307f5d86ba3a None None] PATH_INFO: `/v3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:30.742762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 758/1516] 10.222.0.36 () {54 vars in 925 bytes} [Tue Jul 26 07:25:30 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:25:30.751620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75152757-8fe0-4d2d-9fd3-e0ac9a0cfde0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:30.751989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75152757-8fe0-4d2d-9fd3-e0ac9a0cfde0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:30.752376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75152757-8fe0-4d2d-9fd3-e0ac9a0cfde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:30.829116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-75152757-8fe0-4d2d-9fd3-e0ac9a0cfde0 None None] MFA Rules not processed for user `826fd481bf2e40d6917bb604591a75cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:30.830342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-75152757-8fe0-4d2d-9fd3-e0ac9a0cfde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:30.899340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:30.917662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a54af-13a9-4b18-86b5-307f5d86ba3a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:25:30.924123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 759/1517] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 26 07:25:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:25:30.935139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a54af-13a9-4b18-86b5-307f5d86ba3a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:25:30.941693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad567-8bf5-4a0f-bb66-66387a630a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:25:30.942510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad567-8bf5-4a0f-bb66-66387a630a47 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:30.942830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad567-8bf5-4a0f-bb66-66387a630a47 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:30.943157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad567-8bf5-4a0f-bb66-66387a630a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:30.955103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aad567-8bf5-4a0f-bb66-66387a630a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:25:30.957544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aad567-8bf5-4a0f-bb66-66387a630a47 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:25:30.969345 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 759/1518] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:25:39.786162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1eaf7d-048d-44c2-a0cf-4df6af1b412a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:39.786936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1eaf7d-048d-44c2-a0cf-4df6af1b412a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:39.787227 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1eaf7d-048d-44c2-a0cf-4df6af1b412a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:39.790538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 760/1519] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 26 07:25:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:25:39.799397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b917-1618-4b08-8e48-964e5d6c9c21 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:39.800326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b917-1618-4b08-8e48-964e5d6c9c21 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:39.800326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b917-1618-4b08-8e48-964e5d6c9c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:39.823225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ff88b917-1618-4b08-8e48-964e5d6c9c21 None None] MFA Rules not processed for user `826fd481bf2e40d6917bb604591a75cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:39.824797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ff88b917-1618-4b08-8e48-964e5d6c9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:39.836881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 760/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 26 07:25:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:25:39.845616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1eaf7d-048d-44c2-a0cf-4df6af1b412a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:25:39.860606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1eaf7d-048d-44c2-a0cf-4df6af1b412a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:25:39.866171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67d2b5-a6b7-41e7-b516-805e34610c80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:25:39.866824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67d2b5-a6b7-41e7-b516-805e34610c80 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:39.867104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67d2b5-a6b7-41e7-b516-805e34610c80 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:39.867380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67d2b5-a6b7-41e7-b516-805e34610c80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:39.879360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67d2b5-a6b7-41e7-b516-805e34610c80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:25:39.882497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67d2b5-a6b7-41e7-b516-805e34610c80 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:25:39.902093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 761/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:25:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:25:42.277156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486d4f-c953-418d-bf2c-061a9dc2cd6b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:42.277828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486d4f-c953-418d-bf2c-061a9dc2cd6b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:42.277828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486d4f-c953-418d-bf2c-061a9dc2cd6b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:42.279179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:25:42.284969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af10f7b-81bf-470c-9f8e-23d742668332 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:42.285671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af10f7b-81bf-470c-9f8e-23d742668332 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:42.285671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af10f7b-81bf-470c-9f8e-23d742668332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:42.308508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5af10f7b-81bf-470c-9f8e-23d742668332 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:42.309823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5af10f7b-81bf-470c-9f8e-23d742668332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:42.319496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:25:42.583519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486d4f-c953-418d-bf2c-061a9dc2cd6b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:25:42.601522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486d4f-c953-418d-bf2c-061a9dc2cd6b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:25:42.608199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0a5c6-bf6d-40fc-adfc-c8feb74a3051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:25:42.608902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0a5c6-bf6d-40fc-adfc-c8feb74a3051 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:42.609223 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0a5c6-bf6d-40fc-adfc-c8feb74a3051 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:42.609580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0a5c6-bf6d-40fc-adfc-c8feb74a3051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:42.619959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0a5c6-bf6d-40fc-adfc-c8feb74a3051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:25:42.621778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0a5c6-bf6d-40fc-adfc-c8feb74a3051 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:25:42.635255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 762/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:25:43.519249 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806428db-06b7-4d4d-94a9-b0c61a11de7a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:43.519923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806428db-06b7-4d4d-94a9-b0c61a11de7a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:43.519923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806428db-06b7-4d4d-94a9-b0c61a11de7a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:43.521248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:25:43.527044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ce3e6-2128-4ddd-9b57-59da7c63e761 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:43.527695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ce3e6-2128-4ddd-9b57-59da7c63e761 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:43.527695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ce3e6-2128-4ddd-9b57-59da7c63e761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:43.549949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0d3ce3e6-2128-4ddd-9b57-59da7c63e761 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:43.551232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0d3ce3e6-2128-4ddd-9b57-59da7c63e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:43.560075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:25:43.720875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806428db-06b7-4d4d-94a9-b0c61a11de7a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:25:43.737782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806428db-06b7-4d4d-94a9-b0c61a11de7a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:25:43.744140 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7088a38-647a-45cd-bc29-ab7e860bf94b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:25:43.744796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7088a38-647a-45cd-bc29-ab7e860bf94b service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:43.745078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7088a38-647a-45cd-bc29-ab7e860bf94b service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:43.745387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7088a38-647a-45cd-bc29-ab7e860bf94b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:43.755599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7088a38-647a-45cd-bc29-ab7e860bf94b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:25:43.757285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7088a38-647a-45cd-bc29-ab7e860bf94b service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:25:43.768572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 764/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:25:47.949042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1718-857c-4d22-af84-a6ed648ea15b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:47.949831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1718-857c-4d22-af84-a6ed648ea15b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:47.949831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1718-857c-4d22-af84-a6ed648ea15b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:47.951109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:25:47.958726 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18bd13-e523-4f7a-9a8a-1d32e14c83d6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:47.959367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18bd13-e523-4f7a-9a8a-1d32e14c83d6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:47.959646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18bd13-e523-4f7a-9a8a-1d32e14c83d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:47.994491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ea18bd13-e523-4f7a-9a8a-1d32e14c83d6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:47.996646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ea18bd13-e523-4f7a-9a8a-1d32e14c83d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:48.010892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:25:48.140022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1718-857c-4d22-af84-a6ed648ea15b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:25:48.142152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fffa1718-857c-4d22-af84-a6ed648ea15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:48.183528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:25:48.241773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1718-857c-4d22-af84-a6ed648ea15b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:25:48.246127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcd26f-fbc2-4b30-aa1a-4695a5fd1979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:25:48.246777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcd26f-fbc2-4b30-aa1a-4695a5fd1979 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:48.247056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcd26f-fbc2-4b30-aa1a-4695a5fd1979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:48.247335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcd26f-fbc2-4b30-aa1a-4695a5fd1979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:48.258018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcd26f-fbc2-4b30-aa1a-4695a5fd1979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:25:48.259525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcd26f-fbc2-4b30-aa1a-4695a5fd1979 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:25:48.271287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 765/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:25:51.229472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106dd3-eae1-44f3-9f56-8be4cb187fea None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:51.230051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106dd3-eae1-44f3-9f56-8be4cb187fea None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:51.230378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106dd3-eae1-44f3-9f56-8be4cb187fea None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:51.232935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:25:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:25:51.242107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3547fd-dabb-404e-8971-5d7e02ff6c75 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:51.242727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3547fd-dabb-404e-8971-5d7e02ff6c75 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:51.242727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3547fd-dabb-404e-8971-5d7e02ff6c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:51.266259 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bf3547fd-dabb-404e-8971-5d7e02ff6c75 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:51.267602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bf3547fd-dabb-404e-8971-5d7e02ff6c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:51.277469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:25:51.317840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd106dd3-eae1-44f3-9f56-8be4cb187fea None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:25:51.319712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bd106dd3-eae1-44f3-9f56-8be4cb187fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:51.334626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd106dd3-eae1-44f3-9f56-8be4cb187fea None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:25:51.338752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb8577-0904-40bb-a285-7d1689a2ce1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:25:51.339372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8577-0904-40bb-a285-7d1689a2ce1a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:51.339698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8577-0904-40bb-a285-7d1689a2ce1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:51.340062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8577-0904-40bb-a285-7d1689a2ce1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:51.350824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb8577-0904-40bb-a285-7d1689a2ce1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:25:51.352629 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb8577-0904-40bb-a285-7d1689a2ce1a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:25:51.364239 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 767/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:25:54.966573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcec405-2e11-4edd-9614-231fba516564 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:54.967459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcec405-2e11-4edd-9614-231fba516564 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:54.967459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcec405-2e11-4edd-9614-231fba516564 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:54.968530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:25:54.974814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b202b5e-a795-4c50-9c91-149511e74230 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:54.975623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b202b5e-a795-4c50-9c91-149511e74230 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:54.975623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b202b5e-a795-4c50-9c91-149511e74230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:54.997759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9b202b5e-a795-4c50-9c91-149511e74230 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:54.999038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b202b5e-a795-4c50-9c91-149511e74230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:55.007806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:25:55.333579 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcec405-2e11-4edd-9614-231fba516564 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:25:55.335723 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9fcec405-2e11-4edd-9614-231fba516564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:55.447081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcec405-2e11-4edd-9614-231fba516564 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:25:55.451265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269a3b5-dc7b-405f-b517-e3d2de12734f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:25:55.451986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269a3b5-dc7b-405f-b517-e3d2de12734f service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:55.452287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269a3b5-dc7b-405f-b517-e3d2de12734f service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:55.452568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269a3b5-dc7b-405f-b517-e3d2de12734f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:55.464371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269a3b5-dc7b-405f-b517-e3d2de12734f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:25:55.466449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269a3b5-dc7b-405f-b517-e3d2de12734f service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:25:55.477866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 768/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:25:57.647962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda10f0b-ce8f-47b1-a05d-7ceab109a61e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:57.648776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda10f0b-ce8f-47b1-a05d-7ceab109a61e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:57.648776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda10f0b-ce8f-47b1-a05d-7ceab109a61e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:57.649993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:25:57.656178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e36d-7b03-4335-83df-7353562c18bf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:57.656929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e36d-7b03-4335-83df-7353562c18bf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:57.656929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e36d-7b03-4335-83df-7353562c18bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:57.679168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b988e36d-7b03-4335-83df-7353562c18bf None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:25:57.680531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b988e36d-7b03-4335-83df-7353562c18bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:57.689562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:25:58.020901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda10f0b-ce8f-47b1-a05d-7ceab109a61e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:25:58.022835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cda10f0b-ce8f-47b1-a05d-7ceab109a61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:25:58.040634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda10f0b-ce8f-47b1-a05d-7ceab109a61e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:25:58.045856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5235b-9cf4-4d4e-a087-868a585debc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:25:58.046702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5235b-9cf4-4d4e-a087-868a585debc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:25:58.047382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5235b-9cf4-4d4e-a087-868a585debc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:25:58.047687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5235b-9cf4-4d4e-a087-868a585debc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:25:58.059816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5235b-9cf4-4d4e-a087-868a585debc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:25:58.061533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5235b-9cf4-4d4e-a087-868a585debc2 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:25:58.073746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 770/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:26:07.673428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=63 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:26:08.068250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=37 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:34.262368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e07fa0-8db1-48b4-af00-86991a16cd9a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.263944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e07fa0-8db1-48b4-af00-86991a16cd9a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.264751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e07fa0-8db1-48b4-af00-86991a16cd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.319442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e2e07fa0-8db1-48b4-af00-86991a16cd9a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:34.322179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e2e07fa0-8db1-48b4-af00-86991a16cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:34.347784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 770/1540] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:34.361531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4d3e3-536b-49d4-8c65-e2ed2176a413 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.362501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4d3e3-536b-49d4-8c65-e2ed2176a413 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.362501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4d3e3-536b-49d4-8c65-e2ed2176a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.399347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-73e4d3e3-536b-49d4-8c65-e2ed2176a413 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:34.400613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-73e4d3e3-536b-49d4-8c65-e2ed2176a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:34.413314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 771/1541] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:34.418780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e07fa0-8db1-48b4-af00-86991a16cd9a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:34.431695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e07fa0-8db1-48b4-af00-86991a16cd9a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:34.442168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ca06b-74cc-4392-935b-0b79699a0d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:34.443430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca06b-74cc-4392-935b-0b79699a0d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.443925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca06b-74cc-4392-935b-0b79699a0d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.444422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca06b-74cc-4392-935b-0b79699a0d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.445402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ca06b-74cc-4392-935b-0b79699a0d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:34.445942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ca06b-74cc-4392-935b-0b79699a0d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:34.447985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ca06b-74cc-4392-935b-0b79699a0d98 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:34.466238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 771/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:34.474848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4d3e3-536b-49d4-8c65-e2ed2176a413 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:34.491205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4d3e3-536b-49d4-8c65-e2ed2176a413 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:34.502007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d1044-d22b-45c2-9bc3-9e2f8b3c8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:34.502720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1044-d22b-45c2-9bc3-9e2f8b3c8aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.503002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1044-d22b-45c2-9bc3-9e2f8b3c8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.503279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1044-d22b-45c2-9bc3-9e2f8b3c8aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.503978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d1044-d22b-45c2-9bc3-9e2f8b3c8aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:34.510225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d1044-d22b-45c2-9bc3-9e2f8b3c8aa0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:34.533255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025e167-ed52-48d4-8c92-5a2b4e61792e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.533954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025e167-ed52-48d4-8c92-5a2b4e61792e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.535081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025e167-ed52-48d4-8c92-5a2b4e61792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.571340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8025e167-ed52-48d4-8c92-5a2b4e61792e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:34.572766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8025e167-ed52-48d4-8c92-5a2b4e61792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:34.577808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 772/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:34 2022] POST /identity/v3/projects => generated 361 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:34.584236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d1044-d22b-45c2-9bc3-9e2f8b3c8aa0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:34.730764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d1044-d22b-45c2-9bc3-9e2f8b3c8aa0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:34.743279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d0e6a-7958-4b79-82d9-f4f7da86105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:34.744386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d0e6a-7958-4b79-82d9-f4f7da86105a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.744887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d0e6a-7958-4b79-82d9-f4f7da86105a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.745512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d0e6a-7958-4b79-82d9-f4f7da86105a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.746497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d0e6a-7958-4b79-82d9-f4f7da86105a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:34.747815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-666d0e6a-7958-4b79-82d9-f4f7da86105a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:27:34.747815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jul 26 07:27:34.747815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: Jul 26 07:27:34.754058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d0e6a-7958-4b79-82d9-f4f7da86105a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:34.790173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 772/1544] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:34.792961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 773/1545] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:34 2022] POST /identity/v3/users => generated 281 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:34.804662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025e167-ed52-48d4-8c92-5a2b4e61792e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:34.814671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504fc55-7cf2-4db9-9953-7266068f7692 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.815737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504fc55-7cf2-4db9-9953-7266068f7692 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.816414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504fc55-7cf2-4db9-9953-7266068f7692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.842177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025e167-ed52-48d4-8c92-5a2b4e61792e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:34.850412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2504fc55-7cf2-4db9-9953-7266068f7692 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:34.851687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2504fc55-7cf2-4db9-9953-7266068f7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:34.865955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c2538-02af-4ace-9da4-21d7b29ad3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:34.867333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c2538-02af-4ace-9da4-21d7b29ad3df admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.867813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c2538-02af-4ace-9da4-21d7b29ad3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.868308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c2538-02af-4ace-9da4-21d7b29ad3df admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.869615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c2538-02af-4ace-9da4-21d7b29ad3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:34.873565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c2538-02af-4ace-9da4-21d7b29ad3df admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:34.874517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 774/1546] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:34.881296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504fc55-7cf2-4db9-9953-7266068f7692 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:34.892339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504fc55-7cf2-4db9-9953-7266068f7692 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:34.912289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:34.912988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.913301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.913582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.914554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:34.916193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:34.917674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:27:34.917674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jul 26 07:27:34.917674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: Jul 26 07:27:34.919038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:34.922225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 773/1547] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:34.928433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c2538-02af-4ace-9da4-21d7b29ad3df admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:34.940721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 775/1548] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:34.961183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c2538-02af-4ace-9da4-21d7b29ad3df admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:34.971500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:34.980158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffdf68-85b5-49da-9287-c45c1bc6903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:34.981548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffdf68-85b5-49da-9287-c45c1bc6903b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:34.982042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffdf68-85b5-49da-9287-c45c1bc6903b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:34.982565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffdf68-85b5-49da-9287-c45c1bc6903b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:34.984264 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffdf68-85b5-49da-9287-c45c1bc6903b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:34.988414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffdf68-85b5-49da-9287-c45c1bc6903b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:34.992892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073c04f-bec7-4b5d-a793-485d1bb33dc6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.006257 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ba246-a811-41b9-bb87-7cec615563dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.006921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ba246-a811-41b9-bb87-7cec615563dd admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.007314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ba246-a811-41b9-bb87-7cec615563dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.007600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ba246-a811-41b9-bb87-7cec615563dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.008304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ba246-a811-41b9-bb87-7cec615563dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.010415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ba246-a811-41b9-bb87-7cec615563dd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.024754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 774/1549] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:35.030529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffdf68-85b5-49da-9287-c45c1bc6903b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.057812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffdf68-85b5-49da-9287-c45c1bc6903b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.063792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 776/1550] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:34 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:27:35.067505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f462-1161-43ba-b633-6501def933cb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.067801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f462-1161-43ba-b633-6501def933cb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.068555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe076ca-981b-4b37-9e6c-a02099e1e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.069477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f462-1161-43ba-b633-6501def933cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.069989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe076ca-981b-4b37-9e6c-a02099e1e00a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.070270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe076ca-981b-4b37-9e6c-a02099e1e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.070561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe076ca-981b-4b37-9e6c-a02099e1e00a admin admin] PATH_INFO: `/v3/projects/db928dfee8c041038000cd8e885eff03/users/c5b3459f9f414442926610805a21c70a/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.107814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe076ca-981b-4b37-9e6c-a02099e1e00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db928dfee8c041038000cd8e885eff03, user_id=c5b3459f9f414442926610805a21c70a, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.108848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING py.warnings [None req-3fe076ca-981b-4b37-9e6c-a02099e1e00a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:27:35.108848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: warnings.warn(msg) Jul 26 07:27:35.108848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: Jul 26 07:27:35.112685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe076ca-981b-4b37-9e6c-a02099e1e00a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.113660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d7d2f462-1161-43ba-b633-6501def933cb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.114904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d7d2f462-1161-43ba-b633-6501def933cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.146680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 775/1551] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:35 2022] PUT /identity/v3/projects/db928dfee8c041038000cd8e885eff03/users/c5b3459f9f414442926610805a21c70a/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:35.147665 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe076ca-981b-4b37-9e6c-a02099e1e00a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.279897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 777/1552] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.280866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe076ca-981b-4b37-9e6c-a02099e1e00a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.281514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70881f-9e48-4770-973a-d2e370660be2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.281803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70881f-9e48-4770-973a-d2e370660be2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.282183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70881f-9e48-4770-973a-d2e370660be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.296967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47310f53-909f-472f-bc22-58b73375c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.297669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47310f53-909f-472f-bc22-58b73375c9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.297945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47310f53-909f-472f-bc22-58b73375c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.298211 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47310f53-909f-472f-bc22-58b73375c9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.300660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47310f53-909f-472f-bc22-58b73375c9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.302718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47310f53-909f-472f-bc22-58b73375c9f9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.327011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:35.341590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 776/1553] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:35.344490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e9d71-6574-47ee-a828-5ec33c648585 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.344490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e9d71-6574-47ee-a828-5ec33c648585 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.344490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e9d71-6574-47ee-a828-5ec33c648585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.349444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fc70881f-9e48-4770-973a-d2e370660be2 None None] MFA Rules not processed for user `c5b3459f9f414442926610805a21c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.352120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fc70881f-9e48-4770-973a-d2e370660be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.389896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d49e9d71-6574-47ee-a828-5ec33c648585 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.392020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d49e9d71-6574-47ee-a828-5ec33c648585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.409762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 777/1554] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.412569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a55d-4e79-4308-84e0-7ce91309c481 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.412848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a55d-4e79-4308-84e0-7ce91309c481 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.413126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a55d-4e79-4308-84e0-7ce91309c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.451633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4541a55d-4e79-4308-84e0-7ce91309c481 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.453089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4541a55d-4e79-4308-84e0-7ce91309c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.464522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 778/1555] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.468015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c4d43-d020-40b8-9d38-31b997d1dca6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.468409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c4d43-d020-40b8-9d38-31b997d1dca6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.468688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c4d43-d020-40b8-9d38-31b997d1dca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.475735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 778/1556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.476822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70881f-9e48-4770-973a-d2e370660be2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.493669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70881f-9e48-4770-973a-d2e370660be2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.498381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e58c4d43-d020-40b8-9d38-31b997d1dca6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.500123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e58c4d43-d020-40b8-9d38-31b997d1dca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.505017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a171669-7baa-48b5-aaa9-737e2f8aa2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.505882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171669-7baa-48b5-aaa9-737e2f8aa2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.506264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171669-7baa-48b5-aaa9-737e2f8aa2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.506641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171669-7baa-48b5-aaa9-737e2f8aa2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.507462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a171669-7baa-48b5-aaa9-737e2f8aa2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.508273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 779/1557] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.509432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a171669-7baa-48b5-aaa9-737e2f8aa2b6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.509680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d554c96-1c5d-4195-8d0c-2bd03fae6b5b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.510044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d554c96-1c5d-4195-8d0c-2bd03fae6b5b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.510318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d554c96-1c5d-4195-8d0c-2bd03fae6b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.521109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:35.524159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 779/1558] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:35.526099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e955-3f52-49e5-b2a0-0f8692aef9c9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.527143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e955-3f52-49e5-b2a0-0f8692aef9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.527143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e955-3f52-49e5-b2a0-0f8692aef9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.533884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1d554c96-1c5d-4195-8d0c-2bd03fae6b5b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.535876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1d554c96-1c5d-4195-8d0c-2bd03fae6b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.547738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 780/1559] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.549286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc506e-9b70-4ed9-abbc-ce0735e50161 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.549677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc506e-9b70-4ed9-abbc-ce0735e50161 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.549853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0036e955-3f52-49e5-b2a0-0f8692aef9c9 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.550113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc506e-9b70-4ed9-abbc-ce0735e50161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.551228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0036e955-3f52-49e5-b2a0-0f8692aef9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.560087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 780/1560] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.561551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae8bf-7371-4308-8ca8-4f59e504f2e2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.561970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae8bf-7371-4308-8ca8-4f59e504f2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.562246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae8bf-7371-4308-8ca8-4f59e504f2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.575073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0ebc506e-9b70-4ed9-abbc-ce0735e50161 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.576695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0ebc506e-9b70-4ed9-abbc-ce0735e50161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.585507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-78bae8bf-7371-4308-8ca8-4f59e504f2e2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.586602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 781/1561] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.586798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-78bae8bf-7371-4308-8ca8-4f59e504f2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.590860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc506e-9b70-4ed9-abbc-ce0735e50161 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.595630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 781/1562] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.597034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871069f0-a563-4bf5-88c9-08f362d384c3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.597353 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871069f0-a563-4bf5-88c9-08f362d384c3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.597633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871069f0-a563-4bf5-88c9-08f362d384c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.608242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc506e-9b70-4ed9-abbc-ce0735e50161 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.616159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079e70b-85e0-4acb-84e7-2f30773889e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.617235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079e70b-85e0-4acb-84e7-2f30773889e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.617733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079e70b-85e0-4acb-84e7-2f30773889e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.618142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079e70b-85e0-4acb-84e7-2f30773889e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.619045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-871069f0-a563-4bf5-88c9-08f362d384c3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.619370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079e70b-85e0-4acb-84e7-2f30773889e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.620290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-871069f0-a563-4bf5-88c9-08f362d384c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.621293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING py.warnings [None req-5079e70b-85e0-4acb-84e7-2f30773889e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:27:35.621293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: warnings.warn(msg) Jul 26 07:27:35.621293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: Jul 26 07:27:35.623370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079e70b-85e0-4acb-84e7-2f30773889e3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.628749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 782/1563] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.631541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871069f0-a563-4bf5-88c9-08f362d384c3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.643226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871069f0-a563-4bf5-88c9-08f362d384c3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.650036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45110e99-84bc-451c-9573-4384b02f477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.650844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110e99-84bc-451c-9573-4384b02f477b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.651155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110e99-84bc-451c-9573-4384b02f477b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.651486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110e99-84bc-451c-9573-4384b02f477b admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.652574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45110e99-84bc-451c-9573-4384b02f477b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:35.653084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45110e99-84bc-451c-9573-4384b02f477b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.655759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45110e99-84bc-451c-9573-4384b02f477b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.678578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 783/1564] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:35.678578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45110e99-84bc-451c-9573-4384b02f477b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.678929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 782/1565] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/projects => generated 363 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:35.678929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079e70b-85e0-4acb-84e7-2f30773889e3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.686013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45110e99-84bc-451c-9573-4384b02f477b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.752505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079e70b-85e0-4acb-84e7-2f30773889e3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.757622 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b476c2-fdcb-4818-9c56-f78dae66d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.758260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b476c2-fdcb-4818-9c56-f78dae66d192 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.758536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b476c2-fdcb-4818-9c56-f78dae66d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.758850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b476c2-fdcb-4818-9c56-f78dae66d192 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.759543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b476c2-fdcb-4818-9c56-f78dae66d192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:35.759662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec73985-dfa5-401c-9342-dacc5a1b3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.759845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b476c2-fdcb-4818-9c56-f78dae66d192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.760278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec73985-dfa5-401c-9342-dacc5a1b3d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.760564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec73985-dfa5-401c-9342-dacc5a1b3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.760842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec73985-dfa5-401c-9342-dacc5a1b3d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.761535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b476c2-fdcb-4818-9c56-f78dae66d192 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.761706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec73985-dfa5-401c-9342-dacc5a1b3d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.763179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec73985-dfa5-401c-9342-dacc5a1b3d98 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.774774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 783/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:35.775438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 784/1567] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:35.776624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417a08-1853-4353-84ee-ecc7997b7c2c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.776969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417a08-1853-4353-84ee-ecc7997b7c2c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.777229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417a08-1853-4353-84ee-ecc7997b7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.779405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33144ff-466e-445a-8807-218e87131aec None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.779694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33144ff-466e-445a-8807-218e87131aec None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.779956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33144ff-466e-445a-8807-218e87131aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.800883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a33144ff-466e-445a-8807-218e87131aec None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.802159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a33144ff-466e-445a-8807-218e87131aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.810719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 784/1568] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.812640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33144ff-466e-445a-8807-218e87131aec None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.812777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ee417a08-1853-4353-84ee-ecc7997b7c2c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.815107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ee417a08-1853-4353-84ee-ecc7997b7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.823521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33144ff-466e-445a-8807-218e87131aec None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.828635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 785/1569] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.829947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ae538-db6f-4f80-b99d-24b6db445545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.830839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b16923-174c-4147-bf79-c21aeaa18427 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.831029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae538-db6f-4f80-b99d-24b6db445545 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.831245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b16923-174c-4147-bf79-c21aeaa18427 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.831514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b16923-174c-4147-bf79-c21aeaa18427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.831732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae538-db6f-4f80-b99d-24b6db445545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.832215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae538-db6f-4f80-b99d-24b6db445545 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.833105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ae538-db6f-4f80-b99d-24b6db445545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:35.833710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ae538-db6f-4f80-b99d-24b6db445545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.836415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ae538-db6f-4f80-b99d-24b6db445545 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.853878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 785/1570] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:35.855071 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ae538-db6f-4f80-b99d-24b6db445545 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.861585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a6b16923-174c-4147-bf79-c21aeaa18427 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:35.863803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a6b16923-174c-4147-bf79-c21aeaa18427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:35.868798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ae538-db6f-4f80-b99d-24b6db445545 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.874831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f953-f305-442e-8051-6669392161fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.875630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f953-f305-442e-8051-6669392161fc admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.875966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f953-f305-442e-8051-6669392161fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.876368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f953-f305-442e-8051-6669392161fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.877126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278f953-f305-442e-8051-6669392161fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.878371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 786/1571] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:35.879929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b16923-174c-4147-bf79-c21aeaa18427 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.880160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278f953-f305-442e-8051-6669392161fc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.897147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b16923-174c-4147-bf79-c21aeaa18427 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.905844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094cb72-ab47-4f53-ba29-12d1a35e0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:35.906782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094cb72-ab47-4f53-ba29-12d1a35e0778 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:35.907072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094cb72-ab47-4f53-ba29-12d1a35e0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:35.907398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094cb72-ab47-4f53-ba29-12d1a35e0778 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:35.909479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094cb72-ab47-4f53-ba29-12d1a35e0778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:35.912729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094cb72-ab47-4f53-ba29-12d1a35e0778 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:35.924111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 786/1572] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:35.925206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f953-f305-442e-8051-6669392161fc admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.948512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 787/1573] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/users => generated 288 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:35.949838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094cb72-ab47-4f53-ba29-12d1a35e0778 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:35.966531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094cb72-ab47-4f53-ba29-12d1a35e0778 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:35.995053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:36.018903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f953-f305-442e-8051-6669392161fc admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.026996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ea531-eda2-4bea-80fb-3edd77bfeb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.028174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ea531-eda2-4bea-80fb-3edd77bfeb91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.028600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ea531-eda2-4bea-80fb-3edd77bfeb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.029025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ea531-eda2-4bea-80fb-3edd77bfeb91 admin admin] PATH_INFO: `/v3/projects/4375a44247ab47dd948bbfba321da75f/users/6bc826246d4d4c2f8c837d1fe0d3f13c/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.047073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ea531-eda2-4bea-80fb-3edd77bfeb91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4375a44247ab47dd948bbfba321da75f, user_id=6bc826246d4d4c2f8c837d1fe0d3f13c, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.050000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ea531-eda2-4bea-80fb-3edd77bfeb91 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.055405 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07500c3d-f4cb-4d0e-a9ca-e15b066ca471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.057345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500c3d-f4cb-4d0e-a9ca-e15b066ca471 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.057968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500c3d-f4cb-4d0e-a9ca-e15b066ca471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.058595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500c3d-f4cb-4d0e-a9ca-e15b066ca471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.060523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07500c3d-f4cb-4d0e-a9ca-e15b066ca471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.064379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07500c3d-f4cb-4d0e-a9ca-e15b066ca471 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.066326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 787/1574] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:35 2022] PUT /identity/v3/projects/4375a44247ab47dd948bbfba321da75f/users/6bc826246d4d4c2f8c837d1fe0d3f13c/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:36.066784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ea531-eda2-4bea-80fb-3edd77bfeb91 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.072666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:36.116569 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 788/1575] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:35 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:36.117595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07500c3d-f4cb-4d0e-a9ca-e15b066ca471 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.148244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ea531-eda2-4bea-80fb-3edd77bfeb91 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.187556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07500c3d-f4cb-4d0e-a9ca-e15b066ca471 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.192458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a224cd0-910a-4c78-9f9e-e95b0c12d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.193111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a224cd0-910a-4c78-9f9e-e95b0c12d3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.193430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a224cd0-910a-4c78-9f9e-e95b0c12d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.193709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a224cd0-910a-4c78-9f9e-e95b0c12d3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.194451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a224cd0-910a-4c78-9f9e-e95b0c12d3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:36.194754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a224cd0-910a-4c78-9f9e-e95b0c12d3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.196409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a224cd0-910a-4c78-9f9e-e95b0c12d3d8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.210403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 789/1576] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:36.211952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a224cd0-910a-4c78-9f9e-e95b0c12d3d8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.224221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a224cd0-910a-4c78-9f9e-e95b0c12d3d8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.225663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98704156-d57b-4599-94cb-3168d4c9f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.226718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98704156-d57b-4599-94cb-3168d4c9f8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.227242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98704156-d57b-4599-94cb-3168d4c9f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.227711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98704156-d57b-4599-94cb-3168d4c9f8e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.229024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98704156-d57b-4599-94cb-3168d4c9f8e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:36.229384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfdf95-8b55-4e8f-a766-69d9a1f055a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.229585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98704156-d57b-4599-94cb-3168d4c9f8e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.230043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfdf95-8b55-4e8f-a766-69d9a1f055a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.230353 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfdf95-8b55-4e8f-a766-69d9a1f055a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.230635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfdf95-8b55-4e8f-a766-69d9a1f055a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.231378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfdf95-8b55-4e8f-a766-69d9a1f055a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.232719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98704156-d57b-4599-94cb-3168d4c9f8e4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.233410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfdf95-8b55-4e8f-a766-69d9a1f055a1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.257151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 788/1577] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:36.258558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98704156-d57b-4599-94cb-3168d4c9f8e4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.279368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 790/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:36.281227 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfdf95-8b55-4e8f-a766-69d9a1f055a1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.282387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98704156-d57b-4599-94cb-3168d4c9f8e4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.358375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f58644-450d-49af-9255-1b7722335d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.359171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f58644-450d-49af-9255-1b7722335d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.359450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f58644-450d-49af-9255-1b7722335d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.359721 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f58644-450d-49af-9255-1b7722335d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.360470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f58644-450d-49af-9255-1b7722335d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:36.360774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f58644-450d-49af-9255-1b7722335d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.362517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f58644-450d-49af-9255-1b7722335d02 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.389298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 789/1579] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:36.389298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f58644-450d-49af-9255-1b7722335d02 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.389790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfdf95-8b55-4e8f-a766-69d9a1f055a1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.389790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd1cdc-bc27-4a33-87f2-fdb2176dc162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.389790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1cdc-bc27-4a33-87f2-fdb2176dc162 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.389790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1cdc-bc27-4a33-87f2-fdb2176dc162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.390536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1cdc-bc27-4a33-87f2-fdb2176dc162 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.390536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd1cdc-bc27-4a33-87f2-fdb2176dc162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.391813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd1cdc-bc27-4a33-87f2-fdb2176dc162 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.397736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f58644-450d-49af-9255-1b7722335d02 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.403798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f49f-e6c7-448f-92d1-dcc9d2bad035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.412143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f49f-e6c7-448f-92d1-dcc9d2bad035 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.412521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f49f-e6c7-448f-92d1-dcc9d2bad035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.412910 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f49f-e6c7-448f-92d1-dcc9d2bad035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.414091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707f49f-e6c7-448f-92d1-dcc9d2bad035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.415298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 791/1580] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:36.416870 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da5890-f33a-4b32-a0af-6024310ddf4e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.417007 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707f49f-e6c7-448f-92d1-dcc9d2bad035 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.417155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da5890-f33a-4b32-a0af-6024310ddf4e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.417455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da5890-f33a-4b32-a0af-6024310ddf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.433485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 790/1581] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:36.434495 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f49f-e6c7-448f-92d1-dcc9d2bad035 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.442537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-72da5890-f33a-4b32-a0af-6024310ddf4e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:36.443771 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-72da5890-f33a-4b32-a0af-6024310ddf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:36.445205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f49f-e6c7-448f-92d1-dcc9d2bad035 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.449893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81cf95-506e-4814-9cae-149d4311ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.450524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81cf95-506e-4814-9cae-149d4311ff80 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.450803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81cf95-506e-4814-9cae-149d4311ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.451081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81cf95-506e-4814-9cae-149d4311ff80 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.451693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 792/1582] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:36.451843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81cf95-506e-4814-9cae-149d4311ff80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.454189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81cf95-506e-4814-9cae-149d4311ff80 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.454769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da5890-f33a-4b32-a0af-6024310ddf4e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.459835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:36.467650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da5890-f33a-4b32-a0af-6024310ddf4e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.474089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49fc49-727d-4574-b4c7-4ac9948f6d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.475020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49fc49-727d-4574-b4c7-4ac9948f6d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.475583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49fc49-727d-4574-b4c7-4ac9948f6d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.475793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49fc49-727d-4574-b4c7-4ac9948f6d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.476462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49fc49-727d-4574-b4c7-4ac9948f6d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.477430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 791/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:36.478063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81cf95-506e-4814-9cae-149d4311ff80 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.478454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49fc49-727d-4574-b4c7-4ac9948f6d9f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.488038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81cf95-506e-4814-9cae-149d4311ff80 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.492876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e857b-f447-4439-a969-a47205fb4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.493518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e857b-f447-4439-a969-a47205fb4300 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.493795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e857b-f447-4439-a969-a47205fb4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.494066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e857b-f447-4439-a969-a47205fb4300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.494728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e857b-f447-4439-a969-a47205fb4300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.496633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e857b-f447-4439-a969-a47205fb4300 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.508450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:36.509850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 793/1584] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:36.510889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49fc49-727d-4574-b4c7-4ac9948f6d9f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.530271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 792/1585] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:36.531123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e857b-f447-4439-a969-a47205fb4300 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.599038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49fc49-727d-4574-b4c7-4ac9948f6d9f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.616213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e857b-f447-4439-a969-a47205fb4300 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.621309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca76dce-1db9-4134-bcde-24f244c2a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.621979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca76dce-1db9-4134-bcde-24f244c2a5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.622304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca76dce-1db9-4134-bcde-24f244c2a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.622635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca76dce-1db9-4134-bcde-24f244c2a5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.623333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca76dce-1db9-4134-bcde-24f244c2a5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.625430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca76dce-1db9-4134-bcde-24f244c2a5a0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.662950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b06c2-3e73-47a8-a08f-f2979b151aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.663577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 793/1586] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:36.663718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b06c2-3e73-47a8-a08f-f2979b151aef admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.663852 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b06c2-3e73-47a8-a08f-f2979b151aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.664201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b06c2-3e73-47a8-a08f-f2979b151aef admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.664906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b06c2-3e73-47a8-a08f-f2979b151aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.665216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca76dce-1db9-4134-bcde-24f244c2a5a0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.667011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b06c2-3e73-47a8-a08f-f2979b151aef admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.691386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 794/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:36.693040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b06c2-3e73-47a8-a08f-f2979b151aef admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.708028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b06c2-3e73-47a8-a08f-f2979b151aef admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.766475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca76dce-1db9-4134-bcde-24f244c2a5a0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.771877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bd79f-727a-4053-bc3a-c3966317ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.772530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bd79f-727a-4053-bc3a-c3966317ec31 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.772810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bd79f-727a-4053-bc3a-c3966317ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.773083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bd79f-727a-4053-bc3a-c3966317ec31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.773845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bd79f-727a-4053-bc3a-c3966317ec31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.775511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bd79f-727a-4053-bc3a-c3966317ec31 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.783868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e642217-9123-433b-9072-10ede6283465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.784618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e642217-9123-433b-9072-10ede6283465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.784904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e642217-9123-433b-9072-10ede6283465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.785189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e642217-9123-433b-9072-10ede6283465 admin admin] PATH_INFO: `/v3/projects/ddb933e3f553457bab7e0caaa5500691/users/1139151af5674689b3f2d47f0958374d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.787415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 794/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:36.788296 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bd79f-727a-4053-bc3a-c3966317ec31 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.810060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e642217-9123-433b-9072-10ede6283465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb933e3f553457bab7e0caaa5500691, user_id=1139151af5674689b3f2d47f0958374d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.815766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e642217-9123-433b-9072-10ede6283465 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.830810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:36.837583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 795/1589] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:36 2022] PUT /identity/v3/projects/ddb933e3f553457bab7e0caaa5500691/users/1139151af5674689b3f2d47f0958374d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:36.838692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e642217-9123-433b-9072-10ede6283465 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.869985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bd79f-727a-4053-bc3a-c3966317ec31 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.909877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e642217-9123-433b-9072-10ede6283465 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.912024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:36.915619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4556cc3-9ec7-47a6-bb67-fa8a90e38bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.916313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4556cc3-9ec7-47a6-bb67-fa8a90e38bae admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.916668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4556cc3-9ec7-47a6-bb67-fa8a90e38bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.916948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4556cc3-9ec7-47a6-bb67-fa8a90e38bae admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.917703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4556cc3-9ec7-47a6-bb67-fa8a90e38bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.919355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4556cc3-9ec7-47a6-bb67-fa8a90e38bae admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.931244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 796/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:36.932129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4556cc3-9ec7-47a6-bb67-fa8a90e38bae admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.943240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4556cc3-9ec7-47a6-bb67-fa8a90e38bae admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:36.949541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4394-2499-4195-b481-290b3dc3179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.950224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4394-2499-4195-b481-290b3dc3179a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.950508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4394-2499-4195-b481-290b3dc3179a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.950927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4394-2499-4195-b481-290b3dc3179a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.951339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab383b-c93e-4e75-84b7-e56d3b85d80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:36.951630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf4394-2499-4195-b481-290b3dc3179a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.952351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab383b-c93e-4e75-84b7-e56d3b85d80d service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:36.952792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab383b-c93e-4e75-84b7-e56d3b85d80d service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:36.953246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab383b-c93e-4e75-84b7-e56d3b85d80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:36.954113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf4394-2499-4195-b481-290b3dc3179a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.965944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab383b-c93e-4e75-84b7-e56d3b85d80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:36.967582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab383b-c93e-4e75-84b7-e56d3b85d80d service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:36.981427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 795/1591] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:36.982604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab383b-c93e-4e75-84b7-e56d3b85d80d service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.988881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 797/1592] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:36.988881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4394-2499-4195-b481-290b3dc3179a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:36.997097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab383b-c93e-4e75-84b7-e56d3b85d80d service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.003110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f807dab-410d-42cf-a881-f04a2e31eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.004141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f807dab-410d-42cf-a881-f04a2e31eeef admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.004590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f807dab-410d-42cf-a881-f04a2e31eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.004914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4394-2499-4195-b481-290b3dc3179a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.005232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f807dab-410d-42cf-a881-f04a2e31eeef admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.006177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f807dab-410d-42cf-a881-f04a2e31eeef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.008577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f807dab-410d-42cf-a881-f04a2e31eeef admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.013464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971143d3-1c95-4844-ac8b-3e733e308065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.014347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971143d3-1c95-4844-ac8b-3e733e308065 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.014817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971143d3-1c95-4844-ac8b-3e733e308065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.015399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971143d3-1c95-4844-ac8b-3e733e308065 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.016661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971143d3-1c95-4844-ac8b-3e733e308065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.020814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971143d3-1c95-4844-ac8b-3e733e308065 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.045659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 796/1593] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/users => generated 288 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:37.045659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f807dab-410d-42cf-a881-f04a2e31eeef admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.059969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f807dab-410d-42cf-a881-f04a2e31eeef admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.061684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 798/1594] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:36 2022] POST /identity/v3/users => generated 291 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:37.064314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971143d3-1c95-4844-ac8b-3e733e308065 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.066346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a97a8-d66f-4cb0-a17d-df81491645e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.067147 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a97a8-d66f-4cb0-a17d-df81491645e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.067488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a97a8-d66f-4cb0-a17d-df81491645e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.067955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a97a8-d66f-4cb0-a17d-df81491645e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.069060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a97a8-d66f-4cb0-a17d-df81491645e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.071089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a97a8-d66f-4cb0-a17d-df81491645e3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.078547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971143d3-1c95-4844-ac8b-3e733e308065 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.084423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 797/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.085835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c756e0-3318-4634-8fb5-c52b8bcab9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.087165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a97a8-d66f-4cb0-a17d-df81491645e3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.088112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c756e0-3318-4634-8fb5-c52b8bcab9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.088715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c756e0-3318-4634-8fb5-c52b8bcab9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.089199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c756e0-3318-4634-8fb5-c52b8bcab9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.090511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c756e0-3318-4634-8fb5-c52b8bcab9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.093724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c756e0-3318-4634-8fb5-c52b8bcab9a7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.110607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a97a8-d66f-4cb0-a17d-df81491645e3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.113128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 799/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.114652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c756e0-3318-4634-8fb5-c52b8bcab9a7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.120811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221e04-db00-476f-82a5-17b108a13a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.121749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221e04-db00-476f-82a5-17b108a13a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.122493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221e04-db00-476f-82a5-17b108a13a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.122842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221e04-db00-476f-82a5-17b108a13a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.124644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f221e04-db00-476f-82a5-17b108a13a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.129370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f221e04-db00-476f-82a5-17b108a13a39 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.131854 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c756e0-3318-4634-8fb5-c52b8bcab9a7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.139024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdae6a4-6e04-4dad-9ea8-190487e51e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.139776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdae6a4-6e04-4dad-9ea8-190487e51e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.140203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdae6a4-6e04-4dad-9ea8-190487e51e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.140543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdae6a4-6e04-4dad-9ea8-190487e51e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.141376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdae6a4-6e04-4dad-9ea8-190487e51e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.143099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdae6a4-6e04-4dad-9ea8-190487e51e2a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.151276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 798/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.152814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221e04-db00-476f-82a5-17b108a13a39 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.162060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 800/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.162060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdae6a4-6e04-4dad-9ea8-190487e51e2a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.171628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221e04-db00-476f-82a5-17b108a13a39 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.174330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdae6a4-6e04-4dad-9ea8-190487e51e2a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.179648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf6a7-0a6d-4823-8802-4bf3172b1eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.179907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3f98-a1ab-41e6-aafa-b71471c42928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.180570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf6a7-0a6d-4823-8802-4bf3172b1eac admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.180796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3f98-a1ab-41e6-aafa-b71471c42928 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.180974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf6a7-0a6d-4823-8802-4bf3172b1eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.181319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3f98-a1ab-41e6-aafa-b71471c42928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.181445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf6a7-0a6d-4823-8802-4bf3172b1eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.181777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3f98-a1ab-41e6-aafa-b71471c42928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.182240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbf6a7-0a6d-4823-8802-4bf3172b1eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.183024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3f98-a1ab-41e6-aafa-b71471c42928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.184045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbf6a7-0a6d-4823-8802-4bf3172b1eac admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.186116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3f98-a1ab-41e6-aafa-b71471c42928 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.199617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 801/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.199617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf6a7-0a6d-4823-8802-4bf3172b1eac admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.210961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 799/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.211648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf6a7-0a6d-4823-8802-4bf3172b1eac admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.212904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3f98-a1ab-41e6-aafa-b71471c42928 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.219938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73084de0-fe2e-44e2-a69b-1c28768085e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.221378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73084de0-fe2e-44e2-a69b-1c28768085e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.221833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73084de0-fe2e-44e2-a69b-1c28768085e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.222421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73084de0-fe2e-44e2-a69b-1c28768085e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.223564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73084de0-fe2e-44e2-a69b-1c28768085e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.225984 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73084de0-fe2e-44e2-a69b-1c28768085e2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.232381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3f98-a1ab-41e6-aafa-b71471c42928 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.243666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 802/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.243976 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9aad2-958c-4095-bfe7-b2bf5f7a8462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.244168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73084de0-fe2e-44e2-a69b-1c28768085e2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.244365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9aad2-958c-4095-bfe7-b2bf5f7a8462 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.244365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9aad2-958c-4095-bfe7-b2bf5f7a8462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.244365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9aad2-958c-4095-bfe7-b2bf5f7a8462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.244365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9aad2-958c-4095-bfe7-b2bf5f7a8462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.244365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9aad2-958c-4095-bfe7-b2bf5f7a8462 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.257959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73084de0-fe2e-44e2-a69b-1c28768085e2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.260768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 800/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.261837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9aad2-958c-4095-bfe7-b2bf5f7a8462 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.267171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616831d-2e77-4d65-a80f-5e429dbf538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.268026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616831d-2e77-4d65-a80f-5e429dbf538c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.268398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616831d-2e77-4d65-a80f-5e429dbf538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.268765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616831d-2e77-4d65-a80f-5e429dbf538c admin admin] PATH_INFO: `/v3/projects/47425914d40a4a709a58448f1f42fde9/users/dfd5c6261e374b869a47c8a3c5bcffa0/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.275146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9aad2-958c-4095-bfe7-b2bf5f7a8462 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.282575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a370e-5f66-484d-89ee-176996d9f3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.284022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a370e-5f66-484d-89ee-176996d9f3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.284659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a370e-5f66-484d-89ee-176996d9f3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.285087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a370e-5f66-484d-89ee-176996d9f3d6 admin admin] PATH_INFO: `/v3/projects/ddb933e3f553457bab7e0caaa5500691/users/1139151af5674689b3f2d47f0958374d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.287601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616831d-2e77-4d65-a80f-5e429dbf538c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47425914d40a4a709a58448f1f42fde9, user_id=dfd5c6261e374b869a47c8a3c5bcffa0, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.289014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a370e-5f66-484d-89ee-176996d9f3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb933e3f553457bab7e0caaa5500691, user_id=1139151af5674689b3f2d47f0958374d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.291029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616831d-2e77-4d65-a80f-5e429dbf538c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.293422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a370e-5f66-484d-89ee-176996d9f3d6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.308696 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 803/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:37 2022] PUT /identity/v3/projects/47425914d40a4a709a58448f1f42fde9/users/dfd5c6261e374b869a47c8a3c5bcffa0/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:37.308696 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616831d-2e77-4d65-a80f-5e429dbf538c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.310458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 801/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:37 2022] PUT /identity/v3/projects/ddb933e3f553457bab7e0caaa5500691/users/1139151af5674689b3f2d47f0958374d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:37.311412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a370e-5f66-484d-89ee-176996d9f3d6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.403945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:37.417654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616831d-2e77-4d65-a80f-5e429dbf538c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.418197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a370e-5f66-484d-89ee-176996d9f3d6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.423947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bad35-cd17-4a51-ac3b-0f55577f09f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.424236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686a596-f9b5-4354-8f1c-3f0e1cc4624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.424523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bad35-cd17-4a51-ac3b-0f55577f09f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.424955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bad35-cd17-4a51-ac3b-0f55577f09f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.425074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bad35-cd17-4a51-ac3b-0f55577f09f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.425386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a596-f9b5-4354-8f1c-3f0e1cc4624d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.425763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a596-f9b5-4354-8f1c-3f0e1cc4624d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.425877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bad35-cd17-4a51-ac3b-0f55577f09f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.426289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a596-f9b5-4354-8f1c-3f0e1cc4624d admin admin] PATH_INFO: `/v3/projects/d2faa29c42654fe69a8c5e12d96b7b4a/users/31bea709ad2f46889801dbba09976e43/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.427571 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bad35-cd17-4a51-ac3b-0f55577f09f8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.444755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 802/1605] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.444755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bad35-cd17-4a51-ac3b-0f55577f09f8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.458135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bad35-cd17-4a51-ac3b-0f55577f09f8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.460777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686a596-f9b5-4354-8f1c-3f0e1cc4624d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2faa29c42654fe69a8c5e12d96b7b4a, user_id=31bea709ad2f46889801dbba09976e43, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.464668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45dda8-55e6-440d-a3c6-3c2490ca389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.465473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45dda8-55e6-440d-a3c6-3c2490ca389d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.466044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45dda8-55e6-440d-a3c6-3c2490ca389d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.466272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45dda8-55e6-440d-a3c6-3c2490ca389d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.467128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45dda8-55e6-440d-a3c6-3c2490ca389d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.467750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686a596-f9b5-4354-8f1c-3f0e1cc4624d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.469348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45dda8-55e6-440d-a3c6-3c2490ca389d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.483086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 803/1606] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.483833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45dda8-55e6-440d-a3c6-3c2490ca389d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.506287 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 804/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:37 2022] PUT /identity/v3/projects/d2faa29c42654fe69a8c5e12d96b7b4a/users/31bea709ad2f46889801dbba09976e43/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:37.507462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686a596-f9b5-4354-8f1c-3f0e1cc4624d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.512380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45dda8-55e6-440d-a3c6-3c2490ca389d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.578423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:37.602740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b833935-49a3-4f63-9b76-29a90e67ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.603597 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833935-49a3-4f63-9b76-29a90e67ff5c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.603844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833935-49a3-4f63-9b76-29a90e67ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.604192 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833935-49a3-4f63-9b76-29a90e67ff5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.605011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b833935-49a3-4f63-9b76-29a90e67ff5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.606824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b833935-49a3-4f63-9b76-29a90e67ff5c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.618394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686a596-f9b5-4354-8f1c-3f0e1cc4624d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.620435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 804/1608] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:37.622256 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebea4e1-634f-4678-bfb2-ffbaa72f81c9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.622537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebea4e1-634f-4678-bfb2-ffbaa72f81c9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.622807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebea4e1-634f-4678-bfb2-ffbaa72f81c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.629109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689fe6-5f48-432d-b82d-174aa769e796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.630247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689fe6-5f48-432d-b82d-174aa769e796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.630685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689fe6-5f48-432d-b82d-174aa769e796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.631141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689fe6-5f48-432d-b82d-174aa769e796 admin admin] PATH_INFO: `/v3/projects/df761e87fe9e428a85f358157ff3d23b/users/baf6077b6d3c47338131c7a258750d2a/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.655078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689fe6-5f48-432d-b82d-174aa769e796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df761e87fe9e428a85f358157ff3d23b, user_id=baf6077b6d3c47338131c7a258750d2a, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.659198 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689fe6-5f48-432d-b82d-174aa769e796 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.666007 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-aebea4e1-634f-4678-bfb2-ffbaa72f81c9 None None] MFA Rules not processed for user `dfd5c6261e374b869a47c8a3c5bcffa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:37.667510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aebea4e1-634f-4678-bfb2-ffbaa72f81c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:37.676138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 805/1609] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:37 2022] PUT /identity/v3/projects/df761e87fe9e428a85f358157ff3d23b/users/baf6077b6d3c47338131c7a258750d2a/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:37.678212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51833533-7bf6-4b8a-9d48-dbd37ddcb4be None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.678516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51833533-7bf6-4b8a-9d48-dbd37ddcb4be None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.678791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51833533-7bf6-4b8a-9d48-dbd37ddcb4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.732419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-51833533-7bf6-4b8a-9d48-dbd37ddcb4be None None] MFA Rules not processed for user `1139151af5674689b3f2d47f0958374d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:37.733740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-51833533-7bf6-4b8a-9d48-dbd37ddcb4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:37.787601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 805/1610] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:37.788793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebea4e1-634f-4678-bfb2-ffbaa72f81c9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.844120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 806/1611] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:37.846274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51833533-7bf6-4b8a-9d48-dbd37ddcb4be None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:37.900703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebea4e1-634f-4678-bfb2-ffbaa72f81c9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.910099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cbf31-7532-423d-bb0d-5a031935a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.911344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cbf31-7532-423d-bb0d-5a031935a3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.911627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cbf31-7532-423d-bb0d-5a031935a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.911902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cbf31-7532-423d-bb0d-5a031935a3c4 admin admin] PATH_INFO: `/v3/projects/93c4e69cb1ef43bcb37159e6a6e1fcfa/users/d9934866496945b7bdebd7e7e78c24b4/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.915451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:37.933234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cbf31-7532-423d-bb0d-5a031935a3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c4e69cb1ef43bcb37159e6a6e1fcfa, user_id=d9934866496945b7bdebd7e7e78c24b4, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.936111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cbf31-7532-423d-bb0d-5a031935a3c4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.946277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51833533-7bf6-4b8a-9d48-dbd37ddcb4be None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:37.951810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d22a-9e7d-48af-be20-911f69d44c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:37.952909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d22a-9e7d-48af-be20-911f69d44c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.953626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d22a-9e7d-48af-be20-911f69d44c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.954313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d22a-9e7d-48af-be20-911f69d44c02 admin admin] PATH_INFO: `/v3/projects/28321448013f4228a65f5c279edb40db/users/b9ece518ba544f5190bb914ccb3fe63d/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.964940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 806/1612] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:37 2022] PUT /identity/v3/projects/93c4e69cb1ef43bcb37159e6a6e1fcfa/users/d9934866496945b7bdebd7e7e78c24b4/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:37.970619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57c48-09d8-4a18-8bc7-95d865639b5d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:37.971131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57c48-09d8-4a18-8bc7-95d865639b5d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:37.971992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57c48-09d8-4a18-8bc7-95d865639b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:37.984639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357d22a-9e7d-48af-be20-911f69d44c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28321448013f4228a65f5c279edb40db, user_id=b9ece518ba544f5190bb914ccb3fe63d, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:37.987765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357d22a-9e7d-48af-be20-911f69d44c02 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:37.994781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-34c57c48-09d8-4a18-8bc7-95d865639b5d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:37.996230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-34c57c48-09d8-4a18-8bc7-95d865639b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:38.009291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 807/1613] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:37 2022] PUT /identity/v3/projects/28321448013f4228a65f5c279edb40db/users/b9ece518ba544f5190bb914ccb3fe63d/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:38.010358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d22a-9e7d-48af-be20-911f69d44c02 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:38.071565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:38.111863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 807/1614] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:38.111863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65e72f-611f-494c-8e2a-fa1cd9535119 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.111863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65e72f-611f-494c-8e2a-fa1cd9535119 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.111863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65e72f-611f-494c-8e2a-fa1cd9535119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.147098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d22a-9e7d-48af-be20-911f69d44c02 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:38.153986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd43c48-0260-41f4-a280-aa094c2de0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:38.155201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd43c48-0260-41f4-a280-aa094c2de0be admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.155705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd43c48-0260-41f4-a280-aa094c2de0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.156161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd43c48-0260-41f4-a280-aa094c2de0be admin admin] PATH_INFO: `/v3/projects/913da9651ce94659a39eba25e76cc93e/users/4a31e0a8824e44c288526ddd0b750394/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.173486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0c65e72f-611f-494c-8e2a-fa1cd9535119 None None] MFA Rules not processed for user `baf6077b6d3c47338131c7a258750d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:38.175161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0c65e72f-611f-494c-8e2a-fa1cd9535119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:38.181115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd43c48-0260-41f4-a280-aa094c2de0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=913da9651ce94659a39eba25e76cc93e, user_id=4a31e0a8824e44c288526ddd0b750394, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:38.184565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd43c48-0260-41f4-a280-aa094c2de0be admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:38.208190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 808/1615] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:38 2022] PUT /identity/v3/projects/913da9651ce94659a39eba25e76cc93e/users/4a31e0a8824e44c288526ddd0b750394/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:38.210427 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b7ed2-e2c3-49a5-a25b-c2ec9af7b8ec None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.210862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b7ed2-e2c3-49a5-a25b-c2ec9af7b8ec None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.211144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b7ed2-e2c3-49a5-a25b-c2ec9af7b8ec None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.212976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 809/1616] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jul 26 07:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:27:38.213847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b7ed2-e2c3-49a5-a25b-c2ec9af7b8ec None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:38.285687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 808/1617] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:38.287037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bfced-3285-4105-8932-4f336afdbc20 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.287325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bfced-3285-4105-8932-4f336afdbc20 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.287781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bfced-3285-4105-8932-4f336afdbc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.309500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-690bfced-3285-4105-8932-4f336afdbc20 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:38.310746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-690bfced-3285-4105-8932-4f336afdbc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:38.317423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b7ed2-e2c3-49a5-a25b-c2ec9af7b8ec None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:38.323124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3c225-09e2-4f06-83d0-3d9bbf450298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:38.323787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3c225-09e2-4f06-83d0-3d9bbf450298 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.324065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3c225-09e2-4f06-83d0-3d9bbf450298 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.324334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3c225-09e2-4f06-83d0-3d9bbf450298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.415932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3c225-09e2-4f06-83d0-3d9bbf450298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:38.418489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3c225-09e2-4f06-83d0-3d9bbf450298 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:38.424973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 809/1618] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:38.427670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77572348-db20-4d86-9ad4-e404eec1aef8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.428176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77572348-db20-4d86-9ad4-e404eec1aef8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.428665 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77572348-db20-4d86-9ad4-e404eec1aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.430784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:38.441233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 810/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:38.442423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3c225-09e2-4f06-83d0-3d9bbf450298 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:38.465365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-77572348-db20-4d86-9ad4-e404eec1aef8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:38.467713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-77572348-db20-4d86-9ad4-e404eec1aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:38.494020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 810/1620] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:38.496955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ddc87-c1a1-4018-b8e4-a8ef4ac10504 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.497480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ddc87-c1a1-4018-b8e4-a8ef4ac10504 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.497957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ddc87-c1a1-4018-b8e4-a8ef4ac10504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.548034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-353ddc87-c1a1-4018-b8e4-a8ef4ac10504 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:38.550413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-353ddc87-c1a1-4018-b8e4-a8ef4ac10504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:38.571214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3c225-09e2-4f06-83d0-3d9bbf450298 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:38.580209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befdf61-c94c-4dce-90ab-360311df43fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:38.581545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdf61-c94c-4dce-90ab-360311df43fc service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.581837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdf61-c94c-4dce-90ab-360311df43fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.582121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdf61-c94c-4dce-90ab-360311df43fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.585444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 811/1621] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:38.589567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230f412-1017-4b5c-bfef-f07c61905500 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.590100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230f412-1017-4b5c-bfef-f07c61905500 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.590659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230f412-1017-4b5c-bfef-f07c61905500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.601632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befdf61-c94c-4dce-90ab-360311df43fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:38.606737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befdf61-c94c-4dce-90ab-360311df43fc service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:38.640488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 811/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:38.641648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befdf61-c94c-4dce-90ab-360311df43fc service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:38.655808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befdf61-c94c-4dce-90ab-360311df43fc service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:38.660691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d339e-4904-4481-b6af-9ab5c9275e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:38.661118 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d339e-4904-4481-b6af-9ab5c9275e35 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.662172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d339e-4904-4481-b6af-9ab5c9275e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.662894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d339e-4904-4481-b6af-9ab5c9275e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.705418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3230f412-1017-4b5c-bfef-f07c61905500 None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:38.708816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3230f412-1017-4b5c-bfef-f07c61905500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:38.765098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d339e-4904-4481-b6af-9ab5c9275e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:38.767123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d339e-4904-4481-b6af-9ab5c9275e35 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:38.794233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 812/1623] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:38.795343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d339e-4904-4481-b6af-9ab5c9275e35 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:38.810031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:38.826771 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d339e-4904-4481-b6af-9ab5c9275e35 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:38.834228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e91bc-ef39-47e3-b28b-aed15ec1ee65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:38.834886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e91bc-ef39-47e3-b28b-aed15ec1ee65 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.835185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e91bc-ef39-47e3-b28b-aed15ec1ee65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.835428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e91bc-ef39-47e3-b28b-aed15ec1ee65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.858819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 812/1624] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jul 26 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:38.859119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230f412-1017-4b5c-bfef-f07c61905500 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:38.860922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e91bc-ef39-47e3-b28b-aed15ec1ee65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:38.870522 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e91bc-ef39-47e3-b28b-aed15ec1ee65 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:38.882328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230f412-1017-4b5c-bfef-f07c61905500 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:38.895814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fd49c-bcd2-4b8e-90d5-cac9ede08bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:38.896570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd49c-bcd2-4b8e-90d5-cac9ede08bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.896877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd49c-bcd2-4b8e-90d5-cac9ede08bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.897230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd49c-bcd2-4b8e-90d5-cac9ede08bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.909019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 813/1625] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:38.911055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e91bc-ef39-47e3-b28b-aed15ec1ee65 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:38.920702 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fd49c-bcd2-4b8e-90d5-cac9ede08bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:38.921954 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e91bc-ef39-47e3-b28b-aed15ec1ee65 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:38.923625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fd49c-bcd2-4b8e-90d5-cac9ede08bb6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:38.927813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1608aa-927a-4a92-a26f-2b51b8401f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:38.929009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1608aa-927a-4a92-a26f-2b51b8401f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.929996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1608aa-927a-4a92-a26f-2b51b8401f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.930161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1608aa-927a-4a92-a26f-2b51b8401f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:38.950158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 813/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:38.950954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fd49c-bcd2-4b8e-90d5-cac9ede08bb6 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:38.958289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1608aa-927a-4a92-a26f-2b51b8401f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:38.959877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1608aa-927a-4a92-a26f-2b51b8401f2d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:38.980680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fd49c-bcd2-4b8e-90d5-cac9ede08bb6 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:38.989780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 814/1627] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:38.990524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1608aa-927a-4a92-a26f-2b51b8401f2d service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:38.993405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470f4ad-958b-48d2-ae37-ea7814dd4f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:38.994062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470f4ad-958b-48d2-ae37-ea7814dd4f1f service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:38.994353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470f4ad-958b-48d2-ae37-ea7814dd4f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:38.994631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470f4ad-958b-48d2-ae37-ea7814dd4f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:39.020786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1608aa-927a-4a92-a26f-2b51b8401f2d service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:39.036264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59336828-88e3-41c2-801c-69b2a65fc061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:39.037371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59336828-88e3-41c2-801c-69b2a65fc061 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:39.037895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59336828-88e3-41c2-801c-69b2a65fc061 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:39.038361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59336828-88e3-41c2-801c-69b2a65fc061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:39.146627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470f4ad-958b-48d2-ae37-ea7814dd4f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:39.148601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470f4ad-958b-48d2-ae37-ea7814dd4f1f service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:39.193343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 814/1628] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:39.209222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59336828-88e3-41c2-801c-69b2a65fc061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:39.221814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59336828-88e3-41c2-801c-69b2a65fc061 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:39.240871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 815/1629] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:39.912231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf597fa1-c20f-4ba2-a91d-7540fe7e9bf3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:39.913438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf597fa1-c20f-4ba2-a91d-7540fe7e9bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:39.913926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf597fa1-c20f-4ba2-a91d-7540fe7e9bf3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:39.915619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 815/1630] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jul 26 07:27:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:27:39.923826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c629962-8b7f-4f7a-a9d5-153094b6ed0c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:39.924370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c629962-8b7f-4f7a-a9d5-153094b6ed0c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:39.924370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c629962-8b7f-4f7a-a9d5-153094b6ed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:39.962635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0c629962-8b7f-4f7a-a9d5-153094b6ed0c None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:39.964032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0c629962-8b7f-4f7a-a9d5-153094b6ed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:39.983003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 816/1631] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jul 26 07:27:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:39.990742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b471-09be-4db1-8509-0c16c77e3be7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:39.991784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b471-09be-4db1-8509-0c16c77e3be7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:39.992220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b471-09be-4db1-8509-0c16c77e3be7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:39.994746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 816/1632] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 26 07:27:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:27:40.007286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074821b-7ab6-4456-b269-24a14197fb7a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:40.007860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074821b-7ab6-4456-b269-24a14197fb7a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:40.008342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074821b-7ab6-4456-b269-24a14197fb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:40.044814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:40.056747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7074821b-7ab6-4456-b269-24a14197fb7a None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:40.058713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7074821b-7ab6-4456-b269-24a14197fb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:40.087559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 817/1633] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:27:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:40.107298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0b471-09be-4db1-8509-0c16c77e3be7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:40.121304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0b471-09be-4db1-8509-0c16c77e3be7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:40.127086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ef4f8-1d45-4876-9a1a-12b220025f08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:40.127805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ef4f8-1d45-4876-9a1a-12b220025f08 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:40.128107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ef4f8-1d45-4876-9a1a-12b220025f08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:40.128367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ef4f8-1d45-4876-9a1a-12b220025f08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:40.142631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ef4f8-1d45-4876-9a1a-12b220025f08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:40.144132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ef4f8-1d45-4876-9a1a-12b220025f08 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:40.160411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 817/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:27:40.441858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949d8c2-b2cd-4b2c-bcc7-4cc7b836cc1f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:40.442336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949d8c2-b2cd-4b2c-bcc7-4cc7b836cc1f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:40.446891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949d8c2-b2cd-4b2c-bcc7-4cc7b836cc1f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:40.449917 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 818/1635] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 26 07:27:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:27:40.463319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142b02e-01f7-408e-948f-06b12661575d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:40.463954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142b02e-01f7-408e-948f-06b12661575d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:40.464514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142b02e-01f7-408e-948f-06b12661575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:40.518825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6142b02e-01f7-408e-948f-06b12661575d None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:40.521003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6142b02e-01f7-408e-948f-06b12661575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:40.540383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 818/1636] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:27:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:40.576067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949d8c2-b2cd-4b2c-bcc7-4cc7b836cc1f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:40.595480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949d8c2-b2cd-4b2c-bcc7-4cc7b836cc1f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:40.603327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599a75-1d11-4ef1-9f87-cd0990014ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:40.604066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599a75-1d11-4ef1-9f87-cd0990014ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:40.604422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599a75-1d11-4ef1-9f87-cd0990014ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:40.604767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599a75-1d11-4ef1-9f87-cd0990014ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:40.630309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599a75-1d11-4ef1-9f87-cd0990014ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:40.631801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599a75-1d11-4ef1-9f87-cd0990014ef4 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:40.662204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 819/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:40.808247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142b02e-01f7-408e-948f-06b12661575d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:40.821062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142b02e-01f7-408e-948f-06b12661575d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:40.830701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:40.831487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:40.831838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:40.832289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] PATH_INFO: `/v3/users/dfd5c6261e374b869a47c8a3c5bcffa0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:40.834179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd5c6261e374b869a47c8a3c5bcffa0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:40.835584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: WARNING py.warnings [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:27:40.835584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: warnings.warn(msg) Jul 26 07:27:40.835584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: Jul 26 07:27:40.838121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:40.958550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd5c6261e374b869a47c8a3c5bcffa0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:40.959415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd5c6261e374b869a47c8a3c5bcffa0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:40.960081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd5c6261e374b869a47c8a3c5bcffa0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:40.993541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd5c6261e374b869a47c8a3c5bcffa0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:41.006095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd5c6261e374b869a47c8a3c5bcffa0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:41.029197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 819/1638] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:27:40 2022] DELETE /identity/v3/users/dfd5c6261e374b869a47c8a3c5bcffa0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:41.034511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9066a0-aeb1-4ba5-9092-33e1844cb65e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:41.035145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9066a0-aeb1-4ba5-9092-33e1844cb65e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:41.035145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9066a0-aeb1-4ba5-9092-33e1844cb65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:41.067808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7d9066a0-aeb1-4ba5-9092-33e1844cb65e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:41.069665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7d9066a0-aeb1-4ba5-9092-33e1844cb65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:41.240836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 820/1639] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:41.272764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:41.277726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:41.386341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:41.465653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf6c85-8fec-4165-9fe2-52e0891a1099 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:41.483699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e485-ceec-40b8-a3a7-b2512014c045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:41.484415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e485-ceec-40b8-a3a7-b2512014c045 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:41.484704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e485-ceec-40b8-a3a7-b2512014c045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:41.484978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e485-ceec-40b8-a3a7-b2512014c045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:41.509719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e485-ceec-40b8-a3a7-b2512014c045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:41.511545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e485-ceec-40b8-a3a7-b2512014c045 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:41.535639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 820/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:43.158680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9066a0-aeb1-4ba5-9092-33e1844cb65e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:43.161495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7d9066a0-aeb1-4ba5-9092-33e1844cb65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:43.212077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9066a0-aeb1-4ba5-9092-33e1844cb65e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:43.235025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:43.237107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:43.238952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:43.246226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] PATH_INFO: `/v3/projects/47425914d40a4a709a58448f1f42fde9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:43.250320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47425914d40a4a709a58448f1f42fde9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:43.255225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: WARNING py.warnings [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:27:43.255225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: warnings.warn(msg) Jul 26 07:27:43.255225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: Jul 26 07:27:43.260453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:43.440399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47425914d40a4a709a58448f1f42fde9', 'request_id': 'req-2d740d1f-8f9e-406d-aa21-64a655a43f2e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:43.455619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47425914d40a4a709a58448f1f42fde9', 'request_id': 'req-2d740d1f-8f9e-406d-aa21-64a655a43f2e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:43.464709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47425914d40a4a709a58448f1f42fde9', 'request_id': 'req-2d740d1f-8f9e-406d-aa21-64a655a43f2e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:43.491074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] The token cache is being invalidate because project 47425914d40a4a709a58448f1f42fde9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:27:43.491523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:43.492323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2d740d1f-8f9e-406d-aa21-64a655a43f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:43.495360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 821/1641] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:27:43 2022] DELETE /identity/v3/projects/47425914d40a4a709a58448f1f42fde9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:43.500344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77612354-1b4c-48b1-a361-c710bf5293b4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:43.501177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77612354-1b4c-48b1-a361-c710bf5293b4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:43.501177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77612354-1b4c-48b1-a361-c710bf5293b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:43.543474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-77612354-1b4c-48b1-a361-c710bf5293b4 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:43.549043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-77612354-1b4c-48b1-a361-c710bf5293b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:43.729321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 821/1642] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:43.740997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335de45-f530-4530-9882-b2642a346126 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:43.741299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335de45-f530-4530-9882-b2642a346126 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:43.741584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335de45-f530-4530-9882-b2642a346126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:43.783004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8335de45-f530-4530-9882-b2642a346126 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:43.786794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8335de45-f530-4530-9882-b2642a346126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:43.811432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 822/1643] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:43.816459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77612354-1b4c-48b1-a361-c710bf5293b4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:43.832141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77612354-1b4c-48b1-a361-c710bf5293b4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:43.842352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9c6c7-f060-4e28-bb30-3c363222cd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:43.843405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9c6c7-f060-4e28-bb30-3c363222cd01 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:43.845193 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9c6c7-f060-4e28-bb30-3c363222cd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:43.845685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9c6c7-f060-4e28-bb30-3c363222cd01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:43.848541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9c6c7-f060-4e28-bb30-3c363222cd01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:43.849049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9c6c7-f060-4e28-bb30-3c363222cd01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:43.856525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9c6c7-f060-4e28-bb30-3c363222cd01 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:43.893507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 822/1644] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:43.899244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335de45-f530-4530-9882-b2642a346126 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:43.916174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335de45-f530-4530-9882-b2642a346126 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:43.929009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4af45-0b96-402d-a15e-e9795be88e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:43.929404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4af45-0b96-402d-a15e-e9795be88e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:43.929551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4af45-0b96-402d-a15e-e9795be88e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:43.929872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4af45-0b96-402d-a15e-e9795be88e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:43.930634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4af45-0b96-402d-a15e-e9795be88e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:43.939291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4af45-0b96-402d-a15e-e9795be88e44 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:44.006877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9c6c7-f060-4e28-bb30-3c363222cd01 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:44.014233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 823/1645] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:43 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:44.023490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9c6c7-f060-4e28-bb30-3c363222cd01 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:44.173728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268268fd-730a-44fa-a280-4a6d3916c8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:44.174809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268268fd-730a-44fa-a280-4a6d3916c8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:44.175326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268268fd-730a-44fa-a280-4a6d3916c8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:44.176307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268268fd-730a-44fa-a280-4a6d3916c8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:44.178013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268268fd-730a-44fa-a280-4a6d3916c8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:44.180734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268268fd-730a-44fa-a280-4a6d3916c8b3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:44.217060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 823/1646] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:44 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:44.221887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4af45-0b96-402d-a15e-e9795be88e44 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:44.238743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4af45-0b96-402d-a15e-e9795be88e44 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:44.247490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b9689-e021-4a6a-8640-5deffa8741b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:44.251650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b9689-e021-4a6a-8640-5deffa8741b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:44.253036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b9689-e021-4a6a-8640-5deffa8741b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:44.253708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b9689-e021-4a6a-8640-5deffa8741b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:44.255007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b9689-e021-4a6a-8640-5deffa8741b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:44.257399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b9689-e021-4a6a-8640-5deffa8741b6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:44.275685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 824/1647] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:44.280744 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268268fd-730a-44fa-a280-4a6d3916c8b3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:44.302938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268268fd-730a-44fa-a280-4a6d3916c8b3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:44.334941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61199fea-43c5-4bab-8a36-a55968442fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:44.336297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61199fea-43c5-4bab-8a36-a55968442fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:44.339082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61199fea-43c5-4bab-8a36-a55968442fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:44.339555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61199fea-43c5-4bab-8a36-a55968442fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:44.344882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61199fea-43c5-4bab-8a36-a55968442fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:44.352799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61199fea-43c5-4bab-8a36-a55968442fe2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:44.378890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 824/1648] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:44.383415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b9689-e021-4a6a-8640-5deffa8741b6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:44.403158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b9689-e021-4a6a-8640-5deffa8741b6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:44.417373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc312a5-8cc3-4be9-8482-0f085e4a3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:44.418299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc312a5-8cc3-4be9-8482-0f085e4a3819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:44.418687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc312a5-8cc3-4be9-8482-0f085e4a3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:44.419069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc312a5-8cc3-4be9-8482-0f085e4a3819 admin admin] PATH_INFO: `/v3/projects/cb308fac55ea4312b28dde3e084582e1/users/19b4967dfd864f789c12fbf8ef55b5e0/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:44.481712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc312a5-8cc3-4be9-8482-0f085e4a3819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb308fac55ea4312b28dde3e084582e1, user_id=19b4967dfd864f789c12fbf8ef55b5e0, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:44.484783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc312a5-8cc3-4be9-8482-0f085e4a3819 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:44.518705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 825/1649] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:44 2022] PUT /identity/v3/projects/cb308fac55ea4312b28dde3e084582e1/users/19b4967dfd864f789c12fbf8ef55b5e0/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:27:44.532174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625314d0-b6f9-4065-a406-810bea7f4662 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:44.532718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625314d0-b6f9-4065-a406-810bea7f4662 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:44.533559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625314d0-b6f9-4065-a406-810bea7f4662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:44.688339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-625314d0-b6f9-4065-a406-810bea7f4662 None None] MFA Rules not processed for user `19b4967dfd864f789c12fbf8ef55b5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:44.690865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-625314d0-b6f9-4065-a406-810bea7f4662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:44.832605 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:44.997837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 825/1650] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:44.998900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc312a5-8cc3-4be9-8482-0f085e4a3819 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:45.015578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:45.183090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc312a5-8cc3-4be9-8482-0f085e4a3819 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:45.198285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0d980-d91b-4960-8a66-c8cf55064b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:45.199117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0d980-d91b-4960-8a66-c8cf55064b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:45.199756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0d980-d91b-4960-8a66-c8cf55064b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:45.200377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0d980-d91b-4960-8a66-c8cf55064b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:45.201281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0d980-d91b-4960-8a66-c8cf55064b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:45.208424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0d980-d91b-4960-8a66-c8cf55064b65 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:45.275950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 826/1651] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:44 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:27:45.280608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625314d0-b6f9-4065-a406-810bea7f4662 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:45.304047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625314d0-b6f9-4065-a406-810bea7f4662 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:45.495717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552a9b6-0b39-42a4-8d73-3b42c6c20c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:45.496397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552a9b6-0b39-42a4-8d73-3b42c6c20c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:45.496683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552a9b6-0b39-42a4-8d73-3b42c6c20c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:45.496963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552a9b6-0b39-42a4-8d73-3b42c6c20c04 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:45.499777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552a9b6-0b39-42a4-8d73-3b42c6c20c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:45.506485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552a9b6-0b39-42a4-8d73-3b42c6c20c04 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:45.582809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 826/1652] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:45 2022] POST /identity/v3/users => generated 300 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:45.587390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0d980-d91b-4960-8a66-c8cf55064b65 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:45.604006 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0d980-d91b-4960-8a66-c8cf55064b65 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:45.629202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153b95b-fadd-4085-bc6a-db1363775d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:45.630130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153b95b-fadd-4085-bc6a-db1363775d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:45.633237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153b95b-fadd-4085-bc6a-db1363775d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:45.633749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153b95b-fadd-4085-bc6a-db1363775d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:45.635755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153b95b-fadd-4085-bc6a-db1363775d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:45.641540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153b95b-fadd-4085-bc6a-db1363775d65 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:45.682189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 827/1653] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:45.687794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552a9b6-0b39-42a4-8d73-3b42c6c20c04 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:45.710456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552a9b6-0b39-42a4-8d73-3b42c6c20c04 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:45.725598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed4deb-be46-47a7-8b83-73aad0995251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:45.745415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed4deb-be46-47a7-8b83-73aad0995251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:45.746089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed4deb-be46-47a7-8b83-73aad0995251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:45.747054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed4deb-be46-47a7-8b83-73aad0995251 admin admin] PATH_INFO: `/v3/projects/2142ab217f6e46cd954ba3645a1cf745/users/708c7641a4ac47079e41ea1a7105fd17/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:45.796305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed4deb-be46-47a7-8b83-73aad0995251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2142ab217f6e46cd954ba3645a1cf745, user_id=708c7641a4ac47079e41ea1a7105fd17, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:45.799636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed4deb-be46-47a7-8b83-73aad0995251 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:45.828323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 827/1654] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:45 2022] PUT /identity/v3/projects/2142ab217f6e46cd954ba3645a1cf745/users/708c7641a4ac47079e41ea1a7105fd17/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:45.832615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153b95b-fadd-4085-bc6a-db1363775d65 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:45.855739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153b95b-fadd-4085-bc6a-db1363775d65 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:46.048975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abff3fe-5503-40b3-9ae9-a4632190e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:46.050332 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abff3fe-5503-40b3-9ae9-a4632190e51d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:46.050935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abff3fe-5503-40b3-9ae9-a4632190e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:46.051494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abff3fe-5503-40b3-9ae9-a4632190e51d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:46.053774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abff3fe-5503-40b3-9ae9-a4632190e51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:46.058241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abff3fe-5503-40b3-9ae9-a4632190e51d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:46.105479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 828/1655] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:27:46.107424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed4deb-be46-47a7-8b83-73aad0995251 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:46.136092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed4deb-be46-47a7-8b83-73aad0995251 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:46.163151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e9dd-c41b-4765-94b1-1e848ecdd071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:46.164573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e9dd-c41b-4765-94b1-1e848ecdd071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:46.165455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e9dd-c41b-4765-94b1-1e848ecdd071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:46.169111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e9dd-c41b-4765-94b1-1e848ecdd071 admin admin] PATH_INFO: `/v3/projects/2142ab217f6e46cd954ba3645a1cf745/users/708c7641a4ac47079e41ea1a7105fd17/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:46.180372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900e9dd-c41b-4765-94b1-1e848ecdd071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2142ab217f6e46cd954ba3645a1cf745, user_id=708c7641a4ac47079e41ea1a7105fd17, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:46.191050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900e9dd-c41b-4765-94b1-1e848ecdd071 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:46.239245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 828/1656] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:27:46 2022] PUT /identity/v3/projects/2142ab217f6e46cd954ba3645a1cf745/users/708c7641a4ac47079e41ea1a7105fd17/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:46.249865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a811006-be2b-4566-a401-064a415daa47 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:46.250516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a811006-be2b-4566-a401-064a415daa47 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:46.251098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a811006-be2b-4566-a401-064a415daa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:46.345580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4a811006-be2b-4566-a401-064a415daa47 None None] MFA Rules not processed for user `708c7641a4ac47079e41ea1a7105fd17`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:46.348007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4a811006-be2b-4566-a401-064a415daa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:46.575349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 829/1657] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:46.652407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e9dd-c41b-4765-94b1-1e848ecdd071 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:46.656055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0900e9dd-c41b-4765-94b1-1e848ecdd071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:46.816808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e9dd-c41b-4765-94b1-1e848ecdd071 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:46.830726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bfde5-f808-4d04-a089-415ed2fad0fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:46.832507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bfde5-f808-4d04-a089-415ed2fad0fe service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:46.833102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bfde5-f808-4d04-a089-415ed2fad0fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:46.834222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bfde5-f808-4d04-a089-415ed2fad0fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:46.867575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bfde5-f808-4d04-a089-415ed2fad0fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:46.873616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bfde5-f808-4d04-a089-415ed2fad0fe service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:46.923871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 829/1658] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:47.213637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a811006-be2b-4566-a401-064a415daa47 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:47.219202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:47.515470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a811006-be2b-4566-a401-064a415daa47 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:47.554965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:47.554965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:47.554965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:47.557246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] PATH_INFO: `/v3/users/19b4967dfd864f789c12fbf8ef55b5e0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:47.562819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b4967dfd864f789c12fbf8ef55b5e0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:47.572879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:47.746688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b4967dfd864f789c12fbf8ef55b5e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:47.764911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b4967dfd864f789c12fbf8ef55b5e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:47.791949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b4967dfd864f789c12fbf8ef55b5e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:47.811513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b4967dfd864f789c12fbf8ef55b5e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:47.816839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba90e6d2-f2e8-4be7-aa57-8f923d97f006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b4967dfd864f789c12fbf8ef55b5e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:47.833844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 830/1659] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:27:47 2022] DELETE /identity/v3/users/19b4967dfd864f789c12fbf8ef55b5e0 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:27:47.836428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44904c-ff6f-412c-aaf7-bac459cd8802 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:47.837228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44904c-ff6f-412c-aaf7-bac459cd8802 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:47.837228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44904c-ff6f-412c-aaf7-bac459cd8802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:47.873323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-df44904c-ff6f-412c-aaf7-bac459cd8802 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:47.882738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-df44904c-ff6f-412c-aaf7-bac459cd8802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:47.907991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:47.927968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e290e-93b1-4d44-a560-6f84cb8001a0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:47.928402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e290e-93b1-4d44-a560-6f84cb8001a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:47.928542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e290e-93b1-4d44-a560-6f84cb8001a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:48.027888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-948e290e-93b1-4d44-a560-6f84cb8001a0 None None] MFA Rules not processed for user `6bc826246d4d4c2f8c837d1fe0d3f13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:48.031517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-948e290e-93b1-4d44-a560-6f84cb8001a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:48.112713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 830/1660] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:48.358529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44904c-ff6f-412c-aaf7-bac459cd8802 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:48.361518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-df44904c-ff6f-412c-aaf7-bac459cd8802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:48.362687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 831/1661] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:48.385621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476492bd-5fc3-4a43-a1d3-017525236153 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:48.386470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476492bd-5fc3-4a43-a1d3-017525236153 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:48.387243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476492bd-5fc3-4a43-a1d3-017525236153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:48.448547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-476492bd-5fc3-4a43-a1d3-017525236153 None None] MFA Rules not processed for user `6bc826246d4d4c2f8c837d1fe0d3f13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:48.454177 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-476492bd-5fc3-4a43-a1d3-017525236153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:48.477119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 832/1662] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:48.495036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476492bd-5fc3-4a43-a1d3-017525236153 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:48.496872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-476492bd-5fc3-4a43-a1d3-017525236153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:48.506773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:48.728713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44904c-ff6f-412c-aaf7-bac459cd8802 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:48.745003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc116e-af16-47d7-b53d-5743701f5f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:48.745732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc116e-af16-47d7-b53d-5743701f5f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:48.746459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc116e-af16-47d7-b53d-5743701f5f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:48.746757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc116e-af16-47d7-b53d-5743701f5f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:48.757404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476492bd-5fc3-4a43-a1d3-017525236153 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:48.774395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c40e66-0cb1-4947-8eb0-5e5fa1295a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:48.776779 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c40e66-0cb1-4947-8eb0-5e5fa1295a5f service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:48.777186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c40e66-0cb1-4947-8eb0-5e5fa1295a5f service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:48.777558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c40e66-0cb1-4947-8eb0-5e5fa1295a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:48.792670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc116e-af16-47d7-b53d-5743701f5f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:48.798226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc116e-af16-47d7-b53d-5743701f5f69 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:48.800960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c40e66-0cb1-4947-8eb0-5e5fa1295a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:48.802743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c40e66-0cb1-4947-8eb0-5e5fa1295a5f service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:48.854159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 831/1663] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:27:48.864694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 833/1664] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:49.891344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b619813-036b-4311-a72f-a1b8d730dbc5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:49.892051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b619813-036b-4311-a72f-a1b8d730dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:49.892051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b619813-036b-4311-a72f-a1b8d730dbc5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:49.893370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 834/1665] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 26 07:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:27:49.918904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dccfbd-010c-47bd-b273-60334486d54d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:49.920595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dccfbd-010c-47bd-b273-60334486d54d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:49.921454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dccfbd-010c-47bd-b273-60334486d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:50.093218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-53dccfbd-010c-47bd-b273-60334486d54d None None] MFA Rules not processed for user `7eab2497edff4c968030b5b0d6814150`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:50.103376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-53dccfbd-010c-47bd-b273-60334486d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:50.155596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 832/1666] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:27:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:50.168265 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b619813-036b-4311-a72f-a1b8d730dbc5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:50.171754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b619813-036b-4311-a72f-a1b8d730dbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:50.201115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b619813-036b-4311-a72f-a1b8d730dbc5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:50.215142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4082e-1666-41b5-a979-b49474d3ee1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:50.216119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4082e-1666-41b5-a979-b49474d3ee1f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:50.216536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4082e-1666-41b5-a979-b49474d3ee1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:50.216897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4082e-1666-41b5-a979-b49474d3ee1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:50.238832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4082e-1666-41b5-a979-b49474d3ee1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:50.240468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4082e-1666-41b5-a979-b49474d3ee1f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:50.253789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 835/1667] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:27:51.093618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dccfbd-010c-47bd-b273-60334486d54d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:51.101192 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-53dccfbd-010c-47bd-b273-60334486d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:51.179932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dccfbd-010c-47bd-b273-60334486d54d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:51.206644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:51.207371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:51.208221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:51.212142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] PATH_INFO: `/v3/users/c5b3459f9f414442926610805a21c70a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:51.215651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b3459f9f414442926610805a21c70a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:51.229736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:51.363366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b3459f9f414442926610805a21c70a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:51.364339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b3459f9f414442926610805a21c70a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:51.365155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b3459f9f414442926610805a21c70a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:51.406998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b3459f9f414442926610805a21c70a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:51.425693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b3459f9f414442926610805a21c70a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:51.456043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453e0ab-5803-4c9b-8625-5d14971ff962 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:51.456980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453e0ab-5803-4c9b-8625-5d14971ff962 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:51.457436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453e0ab-5803-4c9b-8625-5d14971ff962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:51.460418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 833/1668] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:27:51 2022] DELETE /identity/v3/users/c5b3459f9f414442926610805a21c70a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:51.491423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c453e0ab-5803-4c9b-8625-5d14971ff962 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:51.493906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c453e0ab-5803-4c9b-8625-5d14971ff962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:51.594141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 836/1669] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:51.866926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:51.868471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:51.895829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:52.013592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfb8df-d2db-4f3b-9b32-16e8a1ce080f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:52.026970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c311c-e9df-4391-873b-829679c92472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:52.027694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c311c-e9df-4391-873b-829679c92472 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:52.027892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c311c-e9df-4391-873b-829679c92472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:52.028240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c311c-e9df-4391-873b-829679c92472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:52.048209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c311c-e9df-4391-873b-829679c92472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:52.049826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c311c-e9df-4391-873b-829679c92472 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:52.079299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 834/1670] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:52.227864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb6677-afeb-4e3d-89bf-a37056723d85 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:52.228146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb6677-afeb-4e3d-89bf-a37056723d85 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:52.229887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb6677-afeb-4e3d-89bf-a37056723d85 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:52.232157 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 837/1671] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 26 07:27:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:27:52.239963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c311c-e9df-4391-873b-829679c92472 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:52.242530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ae8c311c-e9df-4391-873b-829679c92472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:52.252865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322816e9-4ada-406d-acc1-2095c811e8e3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:52.253497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322816e9-4ada-406d-acc1-2095c811e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:52.253922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322816e9-4ada-406d-acc1-2095c811e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:52.300306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c311c-e9df-4391-873b-829679c92472 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:52.314912 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-322816e9-4ada-406d-acc1-2095c811e8e3 None None] MFA Rules not processed for user `826fd481bf2e40d6917bb604591a75cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:52.315858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:52.316804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:52.317307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:52.319818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] PATH_INFO: `/v3/projects/cb308fac55ea4312b28dde3e084582e1` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:52.322050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-322816e9-4ada-406d-acc1-2095c811e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:52.323027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb308fac55ea4312b28dde3e084582e1)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:52.330686 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:52.499192 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb308fac55ea4312b28dde3e084582e1', 'request_id': 'req-98f903d8-8f75-48c6-8d54-a11d855c2883'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:52.518394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb308fac55ea4312b28dde3e084582e1', 'request_id': 'req-98f903d8-8f75-48c6-8d54-a11d855c2883'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:52.534712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb308fac55ea4312b28dde3e084582e1', 'request_id': 'req-98f903d8-8f75-48c6-8d54-a11d855c2883'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:52.564087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] The token cache is being invalidate because project cb308fac55ea4312b28dde3e084582e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:27:52.564383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:52.570737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98f903d8-8f75-48c6-8d54-a11d855c2883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:52.587128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 835/1672] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:27:52 2022] DELETE /identity/v3/projects/cb308fac55ea4312b28dde3e084582e1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:52.589440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae677e3f-5004-41fb-9716-74b50439cb79 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:52.592549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae677e3f-5004-41fb-9716-74b50439cb79 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:52.595562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae677e3f-5004-41fb-9716-74b50439cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:52.688121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ae677e3f-5004-41fb-9716-74b50439cb79 None None] MFA Rules not processed for user `6bc826246d4d4c2f8c837d1fe0d3f13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:52.689555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ae677e3f-5004-41fb-9716-74b50439cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:52.755101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 838/1673] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 26 07:27:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:52.759854 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322816e9-4ada-406d-acc1-2095c811e8e3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:52.767729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-322816e9-4ada-406d-acc1-2095c811e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:52.868477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322816e9-4ada-406d-acc1-2095c811e8e3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:52.878390 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 836/1674] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:52.879416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae677e3f-5004-41fb-9716-74b50439cb79 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:52.897083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ae677e3f-5004-41fb-9716-74b50439cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:52.912000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:53.053550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:53.101567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae677e3f-5004-41fb-9716-74b50439cb79 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:53.108257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:53.110339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:53.111422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:53.112041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] PATH_INFO: `/v3/users/baf6077b6d3c47338131c7a258750d2a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:53.113878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf6077b6d3c47338131c7a258750d2a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:53.116620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:53.145905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:53.147129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:53.147395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:53.148009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] PATH_INFO: `/v3/users/708c7641a4ac47079e41ea1a7105fd17` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:53.153772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=708c7641a4ac47079e41ea1a7105fd17)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:53.159874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:53.225016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf6077b6d3c47338131c7a258750d2a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.231503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf6077b6d3c47338131c7a258750d2a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.233653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf6077b6d3c47338131c7a258750d2a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.296212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf6077b6d3c47338131c7a258750d2a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.346186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf6077b6d3c47338131c7a258750d2a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.402379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708c7641a4ac47079e41ea1a7105fd17'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.427911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 837/1675] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:27:52 2022] DELETE /identity/v3/users/baf6077b6d3c47338131c7a258750d2a => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:53.432945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:53.440354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708c7641a4ac47079e41ea1a7105fd17'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.462882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:53.518011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708c7641a4ac47079e41ea1a7105fd17'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.584674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708c7641a4ac47079e41ea1a7105fd17'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.587858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fa1488c7-5bff-4928-9f90-bdef8abd2d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708c7641a4ac47079e41ea1a7105fd17'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:53.622672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 839/1676] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:27:52 2022] DELETE /identity/v3/users/708c7641a4ac47079e41ea1a7105fd17 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:53.631465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ed9ce-a443-45b3-a6ef-2a2a662fda1f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:53.631783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ed9ce-a443-45b3-a6ef-2a2a662fda1f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:53.634244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ed9ce-a443-45b3-a6ef-2a2a662fda1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:53.709713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-044ed9ce-a443-45b3-a6ef-2a2a662fda1f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:53.722656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-044ed9ce-a443-45b3-a6ef-2a2a662fda1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:53.891436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ef797-9e43-461b-9cfb-a0d38b0bee63 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:54.070305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 840/1677] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:54.172922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:54.173715 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:54.174003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:54.174284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:54.184913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:54.198752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:54.209645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:54.215118 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:54.237982 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 838/1678] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:54.292720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ed9ce-a443-45b3-a6ef-2a2a662fda1f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:54.294383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-044ed9ce-a443-45b3-a6ef-2a2a662fda1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:54.375234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:54.431269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ed9ce-a443-45b3-a6ef-2a2a662fda1f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:54.443439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c492a1-57f7-4817-a7de-bf2caf8f6763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:54.444120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c492a1-57f7-4817-a7de-bf2caf8f6763 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:54.444402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c492a1-57f7-4817-a7de-bf2caf8f6763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:54.444679 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c492a1-57f7-4817-a7de-bf2caf8f6763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:54.464014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c492a1-57f7-4817-a7de-bf2caf8f6763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:54.465573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c492a1-57f7-4817-a7de-bf2caf8f6763 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:54.488465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 841/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:27:55.892440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:55.897832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:55.978512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5eb3-705d-4bf4-a00c-d811f829d84b service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:56.003161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:56.004446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:56.004983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:56.005421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] PATH_INFO: `/v3/projects/db928dfee8c041038000cd8e885eff03` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:56.014436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=db928dfee8c041038000cd8e885eff03)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:56.018266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:56.230490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db928dfee8c041038000cd8e885eff03', 'request_id': 'req-86aa1c21-339a-4339-8718-e1388c6a0cff'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:56.251918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db928dfee8c041038000cd8e885eff03', 'request_id': 'req-86aa1c21-339a-4339-8718-e1388c6a0cff'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:56.284371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db928dfee8c041038000cd8e885eff03', 'request_id': 'req-86aa1c21-339a-4339-8718-e1388c6a0cff'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:56.354256 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] The token cache is being invalidate because project db928dfee8c041038000cd8e885eff03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:27:56.356104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:56.357513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:56.362668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 839/1680] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:27:55 2022] DELETE /identity/v3/projects/db928dfee8c041038000cd8e885eff03 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:27:56.367415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c492a1-57f7-4817-a7de-bf2caf8f6763 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:56.406452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c492a1-57f7-4817-a7de-bf2caf8f6763 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:56.786244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:56.792567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:56.793225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:56.795945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] PATH_INFO: `/v3/users/1139151af5674689b3f2d47f0958374d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:56.803234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1139151af5674689b3f2d47f0958374d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:56.814519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:56.937990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1139151af5674689b3f2d47f0958374d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:56.954787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1139151af5674689b3f2d47f0958374d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:56.986459 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1139151af5674689b3f2d47f0958374d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:57.006363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1139151af5674689b3f2d47f0958374d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:57.008112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c9156cd4-c623-45ab-a9c1-ecb879ec10c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1139151af5674689b3f2d47f0958374d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:57.022888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 842/1681] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:27:56 2022] DELETE /identity/v3/users/1139151af5674689b3f2d47f0958374d => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:27:57.771712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:57.774262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:57.802512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1c21-339a-4339-8718-e1388c6a0cff admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:58.053909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:58.054940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:58.055372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:58.055733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] PATH_INFO: `/v3/projects/df761e87fe9e428a85f358157ff3d23b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:58.057357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df761e87fe9e428a85f358157ff3d23b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:58.060416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:58.274893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df761e87fe9e428a85f358157ff3d23b', 'request_id': 'req-e41a59b4-29c7-4f53-a7d1-77902212bc55'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:58.325105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df761e87fe9e428a85f358157ff3d23b', 'request_id': 'req-e41a59b4-29c7-4f53-a7d1-77902212bc55'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:58.358107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df761e87fe9e428a85f358157ff3d23b', 'request_id': 'req-e41a59b4-29c7-4f53-a7d1-77902212bc55'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:58.431619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] The token cache is being invalidate because project df761e87fe9e428a85f358157ff3d23b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:27:58.432991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:58.449860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:58.453789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 840/1682] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:27:57 2022] DELETE /identity/v3/projects/df761e87fe9e428a85f358157ff3d23b => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:27:58.459260 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f43f80-42f0-4b7c-9439-0ec61e432c98 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:58.461585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f43f80-42f0-4b7c-9439-0ec61e432c98 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:58.462197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f43f80-42f0-4b7c-9439-0ec61e432c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:58.545829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b1f43f80-42f0-4b7c-9439-0ec61e432c98 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:58.548970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b1f43f80-42f0-4b7c-9439-0ec61e432c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:58.739328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:58.742899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:58.770599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:58.781529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:58.842432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 843/1683] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:27:58.860590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863fc3-ab2f-473c-8cf2-7d6d2c10e80e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:58.861205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863fc3-ab2f-473c-8cf2-7d6d2c10e80e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:58.862890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863fc3-ab2f-473c-8cf2-7d6d2c10e80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:58.953867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c6863fc3-ab2f-473c-8cf2-7d6d2c10e80e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:58.956208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c6863fc3-ab2f-473c-8cf2-7d6d2c10e80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:58.984570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 844/1684] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:58.986924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7ecea-a90f-4680-84ce-feaacaad870f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:58.987408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7ecea-a90f-4680-84ce-feaacaad870f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:58.990587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7ecea-a90f-4680-84ce-feaacaad870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:58.999031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a59b4-29c7-4f53-a7d1-77902212bc55 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:59.013375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:59.014151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:59.014419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:59.014775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] PATH_INFO: `/v3/projects/2142ab217f6e46cd954ba3645a1cf745` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:59.018409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2142ab217f6e46cd954ba3645a1cf745)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:59.020517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:59.118465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2142ab217f6e46cd954ba3645a1cf745', 'request_id': 'req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:59.140038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2142ab217f6e46cd954ba3645a1cf745', 'request_id': 'req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:59.158227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2142ab217f6e46cd954ba3645a1cf745', 'request_id': 'req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:59.179122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1fb7ecea-a90f-4680-84ce-feaacaad870f None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:59.184031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1fb7ecea-a90f-4680-84ce-feaacaad870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:59.196596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] The token cache is being invalidate because project 2142ab217f6e46cd954ba3645a1cf745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:27:59.197226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:59.199862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:27:59.204358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 841/1685] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:27:58 2022] DELETE /identity/v3/projects/2142ab217f6e46cd954ba3645a1cf745 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:27:59.211511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:59.214930 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:59.461429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 845/1686] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:27:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:59.463709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed180f96-9688-4aac-920d-b9618bd73994 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:59.469022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed180f96-9688-4aac-920d-b9618bd73994 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:59.474774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed180f96-9688-4aac-920d-b9618bd73994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:59.568578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ed180f96-9688-4aac-920d-b9618bd73994 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:59.572180 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ed180f96-9688-4aac-920d-b9618bd73994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:59.582745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be02ad6-ee94-4c60-a1ab-99a4a10dac0f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:59.602913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 846/1687] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:59.609832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4d884-8315-4405-af52-3a212a7c43bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:59.609832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4d884-8315-4405-af52-3a212a7c43bf admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:59.609832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4d884-8315-4405-af52-3a212a7c43bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:59.609832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4d884-8315-4405-af52-3a212a7c43bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:59.613975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590dae3-d8f2-4631-bb5a-8fb6b4f79c7c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:59.614645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590dae3-d8f2-4631-bb5a-8fb6b4f79c7c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:59.616048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590dae3-d8f2-4631-bb5a-8fb6b4f79c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:59.632150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4d884-8315-4405-af52-3a212a7c43bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:59.632882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4d884-8315-4405-af52-3a212a7c43bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:59.638997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4d884-8315-4405-af52-3a212a7c43bf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:59.644583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7590dae3-d8f2-4631-bb5a-8fb6b4f79c7c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:27:59.646275 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7590dae3-d8f2-4631-bb5a-8fb6b4f79c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:59.665693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 847/1688] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:27:59.670125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590dae3-d8f2-4631-bb5a-8fb6b4f79c7c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:59.673687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 842/1689] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:27:59.677478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4d884-8315-4405-af52-3a212a7c43bf admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:59.690502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590dae3-d8f2-4631-bb5a-8fb6b4f79c7c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:59.697866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4d884-8315-4405-af52-3a212a7c43bf admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:59.705642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:59.706904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:59.707082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba7a0-1dbf-4ad7-bbc1-f7b7eb35bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:59.707577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:59.707768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba7a0-1dbf-4ad7-bbc1-f7b7eb35bcdb admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:59.708076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba7a0-1dbf-4ad7-bbc1-f7b7eb35bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:59.708358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba7a0-1dbf-4ad7-bbc1-f7b7eb35bcdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:59.708688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:59.709068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ba7a0-1dbf-4ad7-bbc1-f7b7eb35bcdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:59.709923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:27:59.710559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:59.711567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ba7a0-1dbf-4ad7-bbc1-f7b7eb35bcdb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:59.721740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:59.756147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 848/1690] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:27:59.757942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:59.766299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:27:59.780654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 843/1691] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:59 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:27:59.782327 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba7a0-1dbf-4ad7-bbc1-f7b7eb35bcdb admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:27:59.798090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:27:59.909711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba7a0-1dbf-4ad7-bbc1-f7b7eb35bcdb admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:27:59.921476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5bfdd-944b-4c9d-8af1-9ff677dd8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:27:59.922680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5bfdd-944b-4c9d-8af1-9ff677dd8398 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:27:59.923426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5bfdd-944b-4c9d-8af1-9ff677dd8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:27:59.923936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5bfdd-944b-4c9d-8af1-9ff677dd8398 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:27:59.925162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5bfdd-944b-4c9d-8af1-9ff677dd8398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:27:59.928871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5bfdd-944b-4c9d-8af1-9ff677dd8398 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:27:59.974343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 844/1692] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:27:59 2022] POST /identity/v3/projects => generated 405 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:27:59.976355 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5bfdd-944b-4c9d-8af1-9ff677dd8398 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.023328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142066e-1ca7-43e1-ac49-0e3c96947ab7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.060985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:00.071174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5bfdd-944b-4c9d-8af1-9ff677dd8398 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.079169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815c951-4360-42d0-9738-499f6792255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.079169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c951-4360-42d0-9738-499f6792255e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.079169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c951-4360-42d0-9738-499f6792255e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.079169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c951-4360-42d0-9738-499f6792255e admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.080145 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815c951-4360-42d0-9738-499f6792255e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.083933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815c951-4360-42d0-9738-499f6792255e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.142859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 845/1693] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:27:59 2022] POST /identity/v3/users => generated 282 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:00.142859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815c951-4360-42d0-9738-499f6792255e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.168535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815c951-4360-42d0-9738-499f6792255e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.180063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a76a51-5dc2-413a-a1fa-6cf21e536ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.182168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76a51-5dc2-413a-a1fa-6cf21e536ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.182754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76a51-5dc2-413a-a1fa-6cf21e536ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.183038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76a51-5dc2-413a-a1fa-6cf21e536ebe admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.183535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f6e6-6f96-4947-b8e3-f965fc96ff7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.184223 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f6e6-6f96-4947-b8e3-f965fc96ff7c service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.186558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f6e6-6f96-4947-b8e3-f965fc96ff7c service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.187381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a76a51-5dc2-413a-a1fa-6cf21e536ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.187504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f6e6-6f96-4947-b8e3-f965fc96ff7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.192938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a76a51-5dc2-413a-a1fa-6cf21e536ebe admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.250277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 846/1694] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:00 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:00.251820 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a76a51-5dc2-413a-a1fa-6cf21e536ebe admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.266996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a76a51-5dc2-413a-a1fa-6cf21e536ebe admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.279375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c4992-383f-42e0-b1b5-2531d5cab867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.281769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c4992-383f-42e0-b1b5-2531d5cab867 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.282777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c4992-383f-42e0-b1b5-2531d5cab867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.283535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c4992-383f-42e0-b1b5-2531d5cab867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.286994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c4992-383f-42e0-b1b5-2531d5cab867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.292123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c4992-383f-42e0-b1b5-2531d5cab867 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.317547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 847/1695] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:00.320351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c4992-383f-42e0-b1b5-2531d5cab867 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.325503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f6e6-6f96-4947-b8e3-f965fc96ff7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.333941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f6e6-6f96-4947-b8e3-f965fc96ff7c service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.337624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c4992-383f-42e0-b1b5-2531d5cab867 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.345669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51013221-0de6-4035-8219-6b1c73a7c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.346806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51013221-0de6-4035-8219-6b1c73a7c966 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.347271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51013221-0de6-4035-8219-6b1c73a7c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.347758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51013221-0de6-4035-8219-6b1c73a7c966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.348684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51013221-0de6-4035-8219-6b1c73a7c966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.353008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51013221-0de6-4035-8219-6b1c73a7c966 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.368764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 849/1696] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:27:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:28:00.370010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f6e6-6f96-4947-b8e3-f965fc96ff7c service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.373194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 848/1697] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:00.379152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51013221-0de6-4035-8219-6b1c73a7c966 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.404572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51013221-0de6-4035-8219-6b1c73a7c966 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.422356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f6e6-6f96-4947-b8e3-f965fc96ff7c service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.429205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c90a5a-9a3c-411b-9f30-0f6007143eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.430011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c90a5a-9a3c-411b-9f30-0f6007143eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.430307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c90a5a-9a3c-411b-9f30-0f6007143eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.430584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c90a5a-9a3c-411b-9f30-0f6007143eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.435456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c90a5a-9a3c-411b-9f30-0f6007143eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.437527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c90a5a-9a3c-411b-9f30-0f6007143eb2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.446229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d016a3-5b2f-4529-bdbb-bbcb2eff1105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.446910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d016a3-5b2f-4529-bdbb-bbcb2eff1105 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.447210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d016a3-5b2f-4529-bdbb-bbcb2eff1105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.447485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d016a3-5b2f-4529-bdbb-bbcb2eff1105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.448274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d016a3-5b2f-4529-bdbb-bbcb2eff1105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.450414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d016a3-5b2f-4529-bdbb-bbcb2eff1105 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.458860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 849/1698] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:00.460035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c90a5a-9a3c-411b-9f30-0f6007143eb2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.472931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c90a5a-9a3c-411b-9f30-0f6007143eb2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.480649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ead083-4607-4189-8a68-6c052ac59a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.481417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ead083-4607-4189-8a68-6c052ac59a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.481677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ead083-4607-4189-8a68-6c052ac59a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.481962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ead083-4607-4189-8a68-6c052ac59a21 admin admin] PATH_INFO: `/v3/projects/6d014f2ccdaa47b6bc079a6eea0a47f0/users/6769dffb08504b97be70bde1a8a5f736/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.493462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 850/1699] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:00.494472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d016a3-5b2f-4529-bdbb-bbcb2eff1105 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.522551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d016a3-5b2f-4529-bdbb-bbcb2eff1105 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.525311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ead083-4607-4189-8a68-6c052ac59a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d014f2ccdaa47b6bc079a6eea0a47f0, user_id=6769dffb08504b97be70bde1a8a5f736, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.528163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ead083-4607-4189-8a68-6c052ac59a21 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.535327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74624ba7-591a-4f72-b98f-c6fe37fbcd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.535922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74624ba7-591a-4f72-b98f-c6fe37fbcd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.536206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74624ba7-591a-4f72-b98f-c6fe37fbcd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.536481 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74624ba7-591a-4f72-b98f-c6fe37fbcd56 admin admin] PATH_INFO: `/v3/projects/f3729700c9fd4e6f8196f7251d99bfcf/users/0a108d1f046b442a8eedba7a3d18f612/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.566898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 850/1700] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:00 2022] PUT /identity/v3/projects/6d014f2ccdaa47b6bc079a6eea0a47f0/users/6769dffb08504b97be70bde1a8a5f736/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:00.584672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98d15-2e98-4de2-b6e5-7007d9e9a683 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.585352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98d15-2e98-4de2-b6e5-7007d9e9a683 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.588219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98d15-2e98-4de2-b6e5-7007d9e9a683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.604835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74624ba7-591a-4f72-b98f-c6fe37fbcd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3729700c9fd4e6f8196f7251d99bfcf, user_id=0a108d1f046b442a8eedba7a3d18f612, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.608007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74624ba7-591a-4f72-b98f-c6fe37fbcd56 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.639274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 851/1701] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:00 2022] PUT /identity/v3/projects/f3729700c9fd4e6f8196f7251d99bfcf/users/0a108d1f046b442a8eedba7a3d18f612/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:00.641599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570c75f-0714-4ab6-ae4a-8b48f5bcf67d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.642012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570c75f-0714-4ab6-ae4a-8b48f5bcf67d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.642262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570c75f-0714-4ab6-ae4a-8b48f5bcf67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.675206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:00.680189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b570c75f-0714-4ab6-ae4a-8b48f5bcf67d None None] MFA Rules not processed for user `0a108d1f046b442a8eedba7a3d18f612`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:00.682312 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b570c75f-0714-4ab6-ae4a-8b48f5bcf67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:00.723601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-69d98d15-2e98-4de2-b6e5-7007d9e9a683 None None] MFA Rules not processed for user `6769dffb08504b97be70bde1a8a5f736`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:00.732629 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-69d98d15-2e98-4de2-b6e5-7007d9e9a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:00.792266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 852/1702] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:00.794131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570c75f-0714-4ab6-ae4a-8b48f5bcf67d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.812902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:00.897782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570c75f-0714-4ab6-ae4a-8b48f5bcf67d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.904274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dcd2b-d572-449a-bc02-8186c0c3e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.905314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dcd2b-d572-449a-bc02-8186c0c3e33f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.905821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dcd2b-d572-449a-bc02-8186c0c3e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.906298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dcd2b-d572-449a-bc02-8186c0c3e33f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.908325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dcd2b-d572-449a-bc02-8186c0c3e33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.910951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dcd2b-d572-449a-bc02-8186c0c3e33f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:00.921180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 851/1703] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:00.922733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98d15-2e98-4de2-b6e5-7007d9e9a683 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.952619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98d15-2e98-4de2-b6e5-7007d9e9a683 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:00.965710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 853/1704] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:00 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:00.967262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dcd2b-d572-449a-bc02-8186c0c3e33f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:00.969044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5df50c-b93a-4a8e-ba28-b043292fb569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:00.969917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df50c-b93a-4a8e-ba28-b043292fb569 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:00.970405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df50c-b93a-4a8e-ba28-b043292fb569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:00.970689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df50c-b93a-4a8e-ba28-b043292fb569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:00.971396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5df50c-b93a-4a8e-ba28-b043292fb569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:00.973548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5df50c-b93a-4a8e-ba28-b043292fb569 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.057408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 852/1705] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:00 2022] POST /identity/v3/projects => generated 403 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:01.063729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5df50c-b93a-4a8e-ba28-b043292fb569 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.093544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dcd2b-d572-449a-bc02-8186c0c3e33f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:01.180751 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907e89-94fe-4348-b613-6fb856a34ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:01.181453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907e89-94fe-4348-b613-6fb856a34ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:01.186256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907e89-94fe-4348-b613-6fb856a34ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:01.186668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907e89-94fe-4348-b613-6fb856a34ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:01.187511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30907e89-94fe-4348-b613-6fb856a34ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:01.189829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30907e89-94fe-4348-b613-6fb856a34ccf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.255463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 854/1706] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:00 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:01.262040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907e89-94fe-4348-b613-6fb856a34ccf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.302233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907e89-94fe-4348-b613-6fb856a34ccf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:01.322691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4171-d852-4301-a78a-5d32878ab84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:01.323571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4171-d852-4301-a78a-5d32878ab84d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:01.323786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4171-d852-4301-a78a-5d32878ab84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:01.324023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4171-d852-4301-a78a-5d32878ab84d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:01.328203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5df50c-b93a-4a8e-ba28-b043292fb569 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:01.337790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac4171-d852-4301-a78a-5d32878ab84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:01.337790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac4171-d852-4301-a78a-5d32878ab84d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.342044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd38e32-fbff-4bbe-a163-22f92d45bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:01.342960 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38e32-fbff-4bbe-a163-22f92d45bca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:01.343260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38e32-fbff-4bbe-a163-22f92d45bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:01.343588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38e32-fbff-4bbe-a163-22f92d45bca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:01.345630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd38e32-fbff-4bbe-a163-22f92d45bca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:01.349233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd38e32-fbff-4bbe-a163-22f92d45bca3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.351842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 855/1707] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:01.352850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4171-d852-4301-a78a-5d32878ab84d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.395804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 853/1708] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:01 2022] POST /identity/v3/users => generated 308 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:01.399998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd38e32-fbff-4bbe-a163-22f92d45bca3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.403602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4171-d852-4301-a78a-5d32878ab84d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:01.419435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd38e32-fbff-4bbe-a163-22f92d45bca3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:01.420747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f9be2-77f4-4d08-b930-7c3693b24614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:01.421616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f9be2-77f4-4d08-b930-7c3693b24614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:01.421907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f9be2-77f4-4d08-b930-7c3693b24614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:01.422185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f9be2-77f4-4d08-b930-7c3693b24614 admin admin] PATH_INFO: `/v3/projects/1ae1f04de9de4943a3389febfd1d1db6/users/cfdc35451c5d4cc9b8e74d59ef57824d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:01.436623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5c1a4-95ee-4895-bca5-28c7d7c01dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:01.444265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c1a4-95ee-4895-bca5-28c7d7c01dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:01.444265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c1a4-95ee-4895-bca5-28c7d7c01dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:01.444265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c1a4-95ee-4895-bca5-28c7d7c01dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:01.444265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5c1a4-95ee-4895-bca5-28c7d7c01dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:01.444265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5c1a4-95ee-4895-bca5-28c7d7c01dd9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.466850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 854/1709] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:01.471421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5c1a4-95ee-4895-bca5-28c7d7c01dd9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.484706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f9be2-77f4-4d08-b930-7c3693b24614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1f04de9de4943a3389febfd1d1db6, user_id=cfdc35451c5d4cc9b8e74d59ef57824d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:01.487486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f9be2-77f4-4d08-b930-7c3693b24614 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.488115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5c1a4-95ee-4895-bca5-28c7d7c01dd9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:01.515692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b21d-d73a-4b24-bc75-61a4b401f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:01.516549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b21d-d73a-4b24-bc75-61a4b401f9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:01.516881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b21d-d73a-4b24-bc75-61a4b401f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:01.517399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b21d-d73a-4b24-bc75-61a4b401f9e3 admin admin] PATH_INFO: `/v3/projects/1d1f8df768054d8a9697ab6b24b1f044/users/ad5aed9426ec44f7b302bccfde9fdf79/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:01.545174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:01.566650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 856/1710] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:01 2022] PUT /identity/v3/projects/1ae1f04de9de4943a3389febfd1d1db6/users/cfdc35451c5d4cc9b8e74d59ef57824d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:01.571135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6b21d-d73a-4b24-bc75-61a4b401f9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1f8df768054d8a9697ab6b24b1f044, user_id=ad5aed9426ec44f7b302bccfde9fdf79, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:01.575235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f9be2-77f4-4d08-b930-7c3693b24614 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.576374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6b21d-d73a-4b24-bc75-61a4b401f9e3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.614915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 855/1711] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:01 2022] PUT /identity/v3/projects/1d1f8df768054d8a9697ab6b24b1f044/users/ad5aed9426ec44f7b302bccfde9fdf79/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:01.620795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b21d-d73a-4b24-bc75-61a4b401f9e3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.740427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:01.866805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b21d-d73a-4b24-bc75-61a4b401f9e3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:01.873721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f9be2-77f4-4d08-b930-7c3693b24614 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:01.891691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2124d7-fed3-4083-a9bc-4955a401ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:01.892607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2124d7-fed3-4083-a9bc-4955a401ff1d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:01.892939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2124d7-fed3-4083-a9bc-4955a401ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:01.893229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2124d7-fed3-4083-a9bc-4955a401ff1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:01.894086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2124d7-fed3-4083-a9bc-4955a401ff1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:01.895960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2124d7-fed3-4083-a9bc-4955a401ff1d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.899799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e55674-314b-4bfe-b7e8-a2b78fe45798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:01.900731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e55674-314b-4bfe-b7e8-a2b78fe45798 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:01.903714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e55674-314b-4bfe-b7e8-a2b78fe45798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:01.904340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e55674-314b-4bfe-b7e8-a2b78fe45798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:01.905153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e55674-314b-4bfe-b7e8-a2b78fe45798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:01.917869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e55674-314b-4bfe-b7e8-a2b78fe45798 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.921183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 857/1712] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:01.922631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2124d7-fed3-4083-a9bc-4955a401ff1d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.937143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2124d7-fed3-4083-a9bc-4955a401ff1d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:01.943815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44fdcc-2b9c-4fe3-af93-b6a785bed221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:01.944622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44fdcc-2b9c-4fe3-af93-b6a785bed221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:01.944939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44fdcc-2b9c-4fe3-af93-b6a785bed221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:01.945288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44fdcc-2b9c-4fe3-af93-b6a785bed221 admin admin] PATH_INFO: `/v3/projects/1ae1f04de9de4943a3389febfd1d1db6/users/cfdc35451c5d4cc9b8e74d59ef57824d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:01.947554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44fdcc-2b9c-4fe3-af93-b6a785bed221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1f04de9de4943a3389febfd1d1db6, user_id=cfdc35451c5d4cc9b8e74d59ef57824d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:01.951378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44fdcc-2b9c-4fe3-af93-b6a785bed221 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:01.959361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 856/1713] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:28:01.972717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e55674-314b-4bfe-b7e8-a2b78fe45798 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.990637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 858/1714] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:01 2022] PUT /identity/v3/projects/1ae1f04de9de4943a3389febfd1d1db6/users/cfdc35451c5d4cc9b8e74d59ef57824d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:01.991941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44fdcc-2b9c-4fe3-af93-b6a785bed221 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:01.993881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cf44fdcc-2b9c-4fe3-af93-b6a785bed221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:02.011542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e55674-314b-4bfe-b7e8-a2b78fe45798 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:02.190981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44fdcc-2b9c-4fe3-af93-b6a785bed221 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:02.209951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:02.209951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:02.212985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:02.213501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] PATH_INFO: `/v3/projects/ddb933e3f553457bab7e0caaa5500691` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:02.223019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb933e3f553457bab7e0caaa5500691)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:02.223019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:02.265780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0f84b-6973-4ff3-9806-1ff50a6a1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:02.266698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0f84b-6973-4ff3-9806-1ff50a6a1ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:02.267046 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0f84b-6973-4ff3-9806-1ff50a6a1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:02.267252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0f84b-6973-4ff3-9806-1ff50a6a1ff4 admin admin] PATH_INFO: `/v3/projects/1d1f8df768054d8a9697ab6b24b1f044/users/ad5aed9426ec44f7b302bccfde9fdf79/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:02.277560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0f84b-6973-4ff3-9806-1ff50a6a1ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1f8df768054d8a9697ab6b24b1f044, user_id=ad5aed9426ec44f7b302bccfde9fdf79, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:02.280326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0f84b-6973-4ff3-9806-1ff50a6a1ff4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:02.393523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 857/1715] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:01 2022] PUT /identity/v3/projects/1d1f8df768054d8a9697ab6b24b1f044/users/ad5aed9426ec44f7b302bccfde9fdf79/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:02.396439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0fb15-f03f-4716-8952-8f8e620a3761 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:02.399459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0fb15-f03f-4716-8952-8f8e620a3761 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:02.401146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0fb15-f03f-4716-8952-8f8e620a3761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:02.501212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb933e3f553457bab7e0caaa5500691', 'request_id': 'req-f851a07e-3fa5-4b18-867a-567fd37fdd4a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:02.525783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb933e3f553457bab7e0caaa5500691', 'request_id': 'req-f851a07e-3fa5-4b18-867a-567fd37fdd4a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:02.545009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb933e3f553457bab7e0caaa5500691', 'request_id': 'req-f851a07e-3fa5-4b18-867a-567fd37fdd4a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:02.578941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] The token cache is being invalidate because project ddb933e3f553457bab7e0caaa5500691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:02.579710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:02.581173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f851a07e-3fa5-4b18-867a-567fd37fdd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:02.584809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 859/1716] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:01 2022] DELETE /identity/v3/projects/ddb933e3f553457bab7e0caaa5500691 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:02.588076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7c3ff-d916-42ad-91b4-7ed71e56cc10 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:02.588648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7c3ff-d916-42ad-91b4-7ed71e56cc10 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:02.588648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7c3ff-d916-42ad-91b4-7ed71e56cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:02.595228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-47e0fb15-f03f-4716-8952-8f8e620a3761 None None] MFA Rules not processed for user `cfdc35451c5d4cc9b8e74d59ef57824d`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:02.600578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-47e0fb15-f03f-4716-8952-8f8e620a3761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:02.670052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:02.673852 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-08e7c3ff-d916-42ad-91b4-7ed71e56cc10 None None] MFA Rules not processed for user `ad5aed9426ec44f7b302bccfde9fdf79`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:02.691602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-08e7c3ff-d916-42ad-91b4-7ed71e56cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:02.924563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 858/1717] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:02.927625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38acd77-ecf2-49d7-a70f-01812c974287 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:02.927920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38acd77-ecf2-49d7-a70f-01812c974287 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:02.928196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38acd77-ecf2-49d7-a70f-01812c974287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:02.941907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 860/1718] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:02.956208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7c3ff-d916-42ad-91b4-7ed71e56cc10 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:02.961946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-08e7c3ff-d916-42ad-91b4-7ed71e56cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:02.995340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c38acd77-ecf2-49d7-a70f-01812c974287 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:03.000851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c38acd77-ecf2-49d7-a70f-01812c974287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:03.120637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7c3ff-d916-42ad-91b4-7ed71e56cc10 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:03.146192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9aba-ff6e-4379-a3b1-3d602d767452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:03.147102 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9aba-ff6e-4379-a3b1-3d602d767452 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:03.147581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9aba-ff6e-4379-a3b1-3d602d767452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:03.148026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9aba-ff6e-4379-a3b1-3d602d767452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:03.175189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d9aba-ff6e-4379-a3b1-3d602d767452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:03.177008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d9aba-ff6e-4379-a3b1-3d602d767452 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:03.179305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:03.220168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 861/1719] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:03.222687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9aba-ff6e-4379-a3b1-3d602d767452 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:03.228329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d79d9aba-ff6e-4379-a3b1-3d602d767452 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:03.253445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 859/1720] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:03.257512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45556e-1602-442b-a1b7-add29c956104 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:03.257804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45556e-1602-442b-a1b7-add29c956104 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:03.258088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45556e-1602-442b-a1b7-add29c956104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:03.277979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9aba-ff6e-4379-a3b1-3d602d767452 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:03.293687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e28f75-e504-4236-bfa7-ffd05354af27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:03.298030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e28f75-e504-4236-bfa7-ffd05354af27 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:03.298983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e28f75-e504-4236-bfa7-ffd05354af27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:03.299280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e28f75-e504-4236-bfa7-ffd05354af27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:03.337530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fb45556e-1602-442b-a1b7-add29c956104 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:03.339172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fb45556e-1602-442b-a1b7-add29c956104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:03.342786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e28f75-e504-4236-bfa7-ffd05354af27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:03.344532 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e28f75-e504-4236-bfa7-ffd05354af27 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:03.386213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 860/1721] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:03.387289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45556e-1602-442b-a1b7-add29c956104 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:03.414653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 862/1722] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:03.444225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45556e-1602-442b-a1b7-add29c956104 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:03.458257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8fc67-3c43-4aad-b4e2-3d99f24de148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:03.459234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8fc67-3c43-4aad-b4e2-3d99f24de148 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:03.461583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8fc67-3c43-4aad-b4e2-3d99f24de148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:03.462244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8fc67-3c43-4aad-b4e2-3d99f24de148 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:03.463189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8fc67-3c43-4aad-b4e2-3d99f24de148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:28:03.463937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8fc67-3c43-4aad-b4e2-3d99f24de148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:03.469582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8fc67-3c43-4aad-b4e2-3d99f24de148 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:03.481340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e28f75-e504-4236-bfa7-ffd05354af27 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:03.492060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e28f75-e504-4236-bfa7-ffd05354af27 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:03.511333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a1b6-9c8e-402e-981e-a7d5d55766f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:03.515673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a1b6-9c8e-402e-981e-a7d5d55766f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:03.516283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a1b6-9c8e-402e-981e-a7d5d55766f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:03.516750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a1b6-9c8e-402e-981e-a7d5d55766f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:03.525562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92a9a1b6-9c8e-402e-981e-a7d5d55766f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:03.529598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 861/1723] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:28:03.534891 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8fc67-3c43-4aad-b4e2-3d99f24de148 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:03.555411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8fc67-3c43-4aad-b4e2-3d99f24de148 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:03.584859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e5ba3-4d68-4131-91e6-df25aabe0803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:03.584859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5ba3-4d68-4131-91e6-df25aabe0803 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:03.584859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5ba3-4d68-4131-91e6-df25aabe0803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:03.584859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5ba3-4d68-4131-91e6-df25aabe0803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:03.585462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e5ba3-4d68-4131-91e6-df25aabe0803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:03.585462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e5ba3-4d68-4131-91e6-df25aabe0803 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:03.666621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 862/1724] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:03 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:03.668315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e5ba3-4d68-4131-91e6-df25aabe0803 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:03.811432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9a1b6-9c8e-402e-981e-a7d5d55766f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:03.819872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9a1b6-9c8e-402e-981e-a7d5d55766f5 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:03.841506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e5ba3-4d68-4131-91e6-df25aabe0803 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:03.852705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 863/1725] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:03.865010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a7c11-01ac-40db-ba23-b8a6b1efc0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:03.866166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7c11-01ac-40db-ba23-b8a6b1efc0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:03.866785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7c11-01ac-40db-ba23-b8a6b1efc0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:03.867199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7c11-01ac-40db-ba23-b8a6b1efc0e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:03.868501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a7c11-01ac-40db-ba23-b8a6b1efc0e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:03.872489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a7c11-01ac-40db-ba23-b8a6b1efc0e5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:03.932896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a1b6-9c8e-402e-981e-a7d5d55766f5 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:03.947567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a1b6-9c8e-402e-981e-a7d5d55766f5 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:03.984053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:03.985075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 863/1726] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:03 2022] POST /identity/v3/users => generated 285 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:28:03.989691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a7c11-01ac-40db-ba23-b8a6b1efc0e5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:04.067408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a7c11-01ac-40db-ba23-b8a6b1efc0e5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:04.073457 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c57b2-38ba-4318-a387-34ced63c2e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:04.074398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c57b2-38ba-4318-a387-34ced63c2e7e service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:04.074761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c57b2-38ba-4318-a387-34ced63c2e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:04.075047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c57b2-38ba-4318-a387-34ced63c2e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:04.081368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-045c57b2-38ba-4318-a387-34ced63c2e7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:04.083914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d910b-373a-4abd-8c25-686224326edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:04.085710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d910b-373a-4abd-8c25-686224326edd admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:04.086573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d910b-373a-4abd-8c25-686224326edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:04.087353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d910b-373a-4abd-8c25-686224326edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:04.092132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d910b-373a-4abd-8c25-686224326edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:04.095860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d910b-373a-4abd-8c25-686224326edd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:04.149802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 864/1727] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:04.160068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d910b-373a-4abd-8c25-686224326edd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:04.219138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d910b-373a-4abd-8c25-686224326edd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:04.240919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1dd46-c679-40c9-bbde-6ddb6c0c2622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:04.242521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1dd46-c679-40c9-bbde-6ddb6c0c2622 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:04.243467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1dd46-c679-40c9-bbde-6ddb6c0c2622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:04.243769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1dd46-c679-40c9-bbde-6ddb6c0c2622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:04.244718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1dd46-c679-40c9-bbde-6ddb6c0c2622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:04.257306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1dd46-c679-40c9-bbde-6ddb6c0c2622 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:04.276293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c57b2-38ba-4318-a387-34ced63c2e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:04.277881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c57b2-38ba-4318-a387-34ced63c2e7e service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:04.297742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 865/1728] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:04.304772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1dd46-c679-40c9-bbde-6ddb6c0c2622 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:04.319722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 864/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:03 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:04.377554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1dd46-c679-40c9-bbde-6ddb6c0c2622 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:04.399498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37084c-49e5-4b96-a68c-8e244c4fc183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:04.400424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37084c-49e5-4b96-a68c-8e244c4fc183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:04.400952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37084c-49e5-4b96-a68c-8e244c4fc183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:04.401360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37084c-49e5-4b96-a68c-8e244c4fc183 admin admin] PATH_INFO: `/v3/projects/828699514cb04d1994d28802fc3b179d/users/c08e6c2c7f824fd9857faa1d87858df6/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:04.455102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37084c-49e5-4b96-a68c-8e244c4fc183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828699514cb04d1994d28802fc3b179d, user_id=c08e6c2c7f824fd9857faa1d87858df6, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:04.467624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37084c-49e5-4b96-a68c-8e244c4fc183 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:04.507253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 866/1730] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:04 2022] PUT /identity/v3/projects/828699514cb04d1994d28802fc3b179d/users/c08e6c2c7f824fd9857faa1d87858df6/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:04.524094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a7f9-2e23-408f-bf23-8c26b0e7a07d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:04.524387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a7f9-2e23-408f-bf23-8c26b0e7a07d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:04.524728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a7f9-2e23-408f-bf23-8c26b0e7a07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:04.600460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4819a7f9-2e23-408f-bf23-8c26b0e7a07d None None] MFA Rules not processed for user `c08e6c2c7f824fd9857faa1d87858df6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:04.603973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4819a7f9-2e23-408f-bf23-8c26b0e7a07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:04.841767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 865/1731] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:04.845634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37084c-49e5-4b96-a68c-8e244c4fc183 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:05.019329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:05.098920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37084c-49e5-4b96-a68c-8e244c4fc183 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:05.130151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af294b3f-eb61-4e45-9ec2-3b50132ecc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:05.130829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294b3f-eb61-4e45-9ec2-3b50132ecc31 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:05.131109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294b3f-eb61-4e45-9ec2-3b50132ecc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:05.131382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294b3f-eb61-4e45-9ec2-3b50132ecc31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:05.132184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af294b3f-eb61-4e45-9ec2-3b50132ecc31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:05.134273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af294b3f-eb61-4e45-9ec2-3b50132ecc31 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:05.215787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ef563-11dd-46c4-ab03-a42a66b9909a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:05.216289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ef563-11dd-46c4-ab03-a42a66b9909a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:05.216741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ef563-11dd-46c4-ab03-a42a66b9909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:05.241791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 867/1732] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:04 2022] POST /identity/v3/projects => generated 369 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:05.250747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af294b3f-eb61-4e45-9ec2-3b50132ecc31 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:05.389585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b58ef563-11dd-46c4-ab03-a42a66b9909a None None] MFA Rules not processed for user `d9934866496945b7bdebd7e7e78c24b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:05.392050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b58ef563-11dd-46c4-ab03-a42a66b9909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:05.475765 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af294b3f-eb61-4e45-9ec2-3b50132ecc31 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:05.497527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a0ffa-431d-49ae-b291-98b0cbc6e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:05.498107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a0ffa-431d-49ae-b291-98b0cbc6e30e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:05.498466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a0ffa-431d-49ae-b291-98b0cbc6e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:05.498773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a0ffa-431d-49ae-b291-98b0cbc6e30e admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:05.499463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a0ffa-431d-49ae-b291-98b0cbc6e30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:05.516415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a0ffa-431d-49ae-b291-98b0cbc6e30e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:05.592832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 868/1733] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:05 2022] POST /identity/v3/users => generated 291 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:05.599656 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a0ffa-431d-49ae-b291-98b0cbc6e30e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:05.659572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a0ffa-431d-49ae-b291-98b0cbc6e30e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:05.686468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6537-58e7-4664-8d78-d5a29a196364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:05.687136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6537-58e7-4664-8d78-d5a29a196364 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:05.687420 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6537-58e7-4664-8d78-d5a29a196364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:05.687701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6537-58e7-4664-8d78-d5a29a196364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:05.688425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6537-58e7-4664-8d78-d5a29a196364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:05.690163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6537-58e7-4664-8d78-d5a29a196364 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:05.743202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:05.761845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 869/1734] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:05.769385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6537-58e7-4664-8d78-d5a29a196364 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:05.782052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 866/1735] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:05.807083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6537-58e7-4664-8d78-d5a29a196364 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:05.814660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814c2aa-b60b-44cc-8abb-ffc270b0f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:05.815690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814c2aa-b60b-44cc-8abb-ffc270b0f408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:05.816108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814c2aa-b60b-44cc-8abb-ffc270b0f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:05.816517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814c2aa-b60b-44cc-8abb-ffc270b0f408 admin admin] PATH_INFO: `/v3/projects/da8fd454cee64613ad3bcacf2f6644bd/users/da7f25fee8f745ae8359ee5d8aef1ada/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:05.830110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ef563-11dd-46c4-ab03-a42a66b9909a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:05.833749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b58ef563-11dd-46c4-ab03-a42a66b9909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:05.852996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814c2aa-b60b-44cc-8abb-ffc270b0f408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8fd454cee64613ad3bcacf2f6644bd, user_id=da7f25fee8f745ae8359ee5d8aef1ada, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:05.858237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814c2aa-b60b-44cc-8abb-ffc270b0f408 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:05.919949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 870/1736] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:05 2022] PUT /identity/v3/projects/da8fd454cee64613ad3bcacf2f6644bd/users/da7f25fee8f745ae8359ee5d8aef1ada/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:05.922793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814c2aa-b60b-44cc-8abb-ffc270b0f408 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:06.126571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ef563-11dd-46c4-ab03-a42a66b9909a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:06.168428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814c2aa-b60b-44cc-8abb-ffc270b0f408 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:06.191316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbe079-6b8d-46fe-a5ba-6dd5ebec0cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:06.193094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbe079-6b8d-46fe-a5ba-6dd5ebec0cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:06.194044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbe079-6b8d-46fe-a5ba-6dd5ebec0cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:06.196077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbe079-6b8d-46fe-a5ba-6dd5ebec0cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:06.198549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbe079-6b8d-46fe-a5ba-6dd5ebec0cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:06.207085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbe079-6b8d-46fe-a5ba-6dd5ebec0cb6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:06.248014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 871/1737] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:28:06.252166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbe079-6b8d-46fe-a5ba-6dd5ebec0cb6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:06.294294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbe079-6b8d-46fe-a5ba-6dd5ebec0cb6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:06.317981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a873b-ce50-48ef-9a51-211e794d50a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:06.322899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a873b-ce50-48ef-9a51-211e794d50a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:06.327733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a873b-ce50-48ef-9a51-211e794d50a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:06.329591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a873b-ce50-48ef-9a51-211e794d50a1 admin admin] PATH_INFO: `/v3/projects/da8fd454cee64613ad3bcacf2f6644bd/users/da7f25fee8f745ae8359ee5d8aef1ada/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:06.343507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a873b-ce50-48ef-9a51-211e794d50a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8fd454cee64613ad3bcacf2f6644bd, user_id=da7f25fee8f745ae8359ee5d8aef1ada, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:06.351633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a873b-ce50-48ef-9a51-211e794d50a1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:06.413722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 872/1738] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:06 2022] PUT /identity/v3/projects/da8fd454cee64613ad3bcacf2f6644bd/users/da7f25fee8f745ae8359ee5d8aef1ada/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:06.432780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e799-dfdb-4e99-ba33-b6c3f2a7d586 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:06.436796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e799-dfdb-4e99-ba33-b6c3f2a7d586 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:06.437046 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e799-dfdb-4e99-ba33-b6c3f2a7d586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:06.461183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f23ca9-8369-4695-941b-10dc9bd7b1f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:06.461898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23ca9-8369-4695-941b-10dc9bd7b1f0 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:06.462714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23ca9-8369-4695-941b-10dc9bd7b1f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:06.463415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23ca9-8369-4695-941b-10dc9bd7b1f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:06.532545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:06.554878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fde9e799-dfdb-4e99-ba33-b6c3f2a7d586 None None] MFA Rules not processed for user `da7f25fee8f745ae8359ee5d8aef1ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:06.556919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fde9e799-dfdb-4e99-ba33-b6c3f2a7d586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:06.727173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f23ca9-8369-4695-941b-10dc9bd7b1f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:06.729043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f23ca9-8369-4695-941b-10dc9bd7b1f0 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:06.795506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 867/1739] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 967 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:06.879246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 873/1740] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:07.100921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f23ca9-8369-4695-941b-10dc9bd7b1f0 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:07.247317 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:07.312153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f23ca9-8369-4695-941b-10dc9bd7b1f0 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:07.327995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c74e-13c1-429a-817c-a942656ebfe2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:07.329729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c74e-13c1-429a-817c-a942656ebfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:07.330195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c74e-13c1-429a-817c-a942656ebfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:07.388302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f776c74e-13c1-429a-817c-a942656ebfe2 None None] MFA Rules not processed for user `7eab2497edff4c968030b5b0d6814150`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:07.394394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f776c74e-13c1-429a-817c-a942656ebfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:07.504509 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722af3a7-8126-4744-b859-8937d80c51cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:07.506542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722af3a7-8126-4744-b859-8937d80c51cc service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:07.507822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722af3a7-8126-4744-b859-8937d80c51cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:07.508633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722af3a7-8126-4744-b859-8937d80c51cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:07.540910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722af3a7-8126-4744-b859-8937d80c51cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:07.548420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722af3a7-8126-4744-b859-8937d80c51cc service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:07.586748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 868/1741] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:07.608592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 874/1742] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 26 07:28:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:07.970638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722af3a7-8126-4744-b859-8937d80c51cc service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:07.973438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-722af3a7-8126-4744-b859-8937d80c51cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:08.010826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722af3a7-8126-4744-b859-8937d80c51cc service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:08.031542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe0401-31af-4209-9b18-75e1559f212a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:08.033654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe0401-31af-4209-9b18-75e1559f212a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:08.034038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe0401-31af-4209-9b18-75e1559f212a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:08.037181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe0401-31af-4209-9b18-75e1559f212a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:08.066763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe0401-31af-4209-9b18-75e1559f212a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:08.072001 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe0401-31af-4209-9b18-75e1559f212a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:08.106806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 869/1743] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:08.301700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776c74e-13c1-429a-817c-a942656ebfe2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:08.302846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f776c74e-13c1-429a-817c-a942656ebfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:08.499031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776c74e-13c1-429a-817c-a942656ebfe2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:08.506169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:08.507209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:08.507633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:08.508051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] PATH_INFO: `/v3/users/0a108d1f046b442a8eedba7a3d18f612` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:08.510075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a108d1f046b442a8eedba7a3d18f612)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:08.512777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:08.684889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a108d1f046b442a8eedba7a3d18f612'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:08.689903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a108d1f046b442a8eedba7a3d18f612'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:08.691724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a108d1f046b442a8eedba7a3d18f612'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:08.702580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:08.763167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a108d1f046b442a8eedba7a3d18f612'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:08.785437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58f723f9-a58f-4338-ba3a-1407cb6d2fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a108d1f046b442a8eedba7a3d18f612'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:08.886964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 875/1744] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:08 2022] DELETE /identity/v3/users/0a108d1f046b442a8eedba7a3d18f612 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:08.890307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ef39-e6da-4c3f-8e3d-9afc1df3315c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:08.890864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ef39-e6da-4c3f-8e3d-9afc1df3315c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:08.890864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ef39-e6da-4c3f-8e3d-9afc1df3315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:08.911156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3d44d-32f9-4b06-81ed-d420841f5339 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:08.913657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3d44d-32f9-4b06-81ed-d420841f5339 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:08.914511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3d44d-32f9-4b06-81ed-d420841f5339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:09.057474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-87e3d44d-32f9-4b06-81ed-d420841f5339 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:09.061525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2700ef39-e6da-4c3f-8e3d-9afc1df3315c None None] MFA Rules not processed for user `31bea709ad2f46889801dbba09976e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:09.062832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2700ef39-e6da-4c3f-8e3d-9afc1df3315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:09.065840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-87e3d44d-32f9-4b06-81ed-d420841f5339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:09.385965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 876/1745] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:09.470619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 870/1746] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 581 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:09.483154 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fc24e-2a33-42b8-b2ca-606446b18903 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:09.483650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fc24e-2a33-42b8-b2ca-606446b18903 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:09.484542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fc24e-2a33-42b8-b2ca-606446b18903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:09.552022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ef39-e6da-4c3f-8e3d-9afc1df3315c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:09.553693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2700ef39-e6da-4c3f-8e3d-9afc1df3315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:09.557575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f47fc24e-2a33-42b8-b2ca-606446b18903 None None] MFA Rules not processed for user `31bea709ad2f46889801dbba09976e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:09.558864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f47fc24e-2a33-42b8-b2ca-606446b18903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:09.613661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 877/1747] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:09.627374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fc24e-2a33-42b8-b2ca-606446b18903 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:09.628289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f47fc24e-2a33-42b8-b2ca-606446b18903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:09.762752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ef39-e6da-4c3f-8e3d-9afc1df3315c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:09.767351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a308f6-3a4d-4fdf-a1e6-3a7a117e9957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:09.768641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a308f6-3a4d-4fdf-a1e6-3a7a117e9957 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:09.768925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a308f6-3a4d-4fdf-a1e6-3a7a117e9957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:09.769201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a308f6-3a4d-4fdf-a1e6-3a7a117e9957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:09.784474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a308f6-3a4d-4fdf-a1e6-3a7a117e9957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:09.786020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a308f6-3a4d-4fdf-a1e6-3a7a117e9957 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:09.807582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 871/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:09.930492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fc24e-2a33-42b8-b2ca-606446b18903 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:09.950262 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84dc0-bc51-4cd2-a1c4-77265c9fe078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:09.950939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84dc0-bc51-4cd2-a1c4-77265c9fe078 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:09.951221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84dc0-bc51-4cd2-a1c4-77265c9fe078 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:09.951499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84dc0-bc51-4cd2-a1c4-77265c9fe078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:09.999306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a84dc0-bc51-4cd2-a1c4-77265c9fe078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:10.002308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a84dc0-bc51-4cd2-a1c4-77265c9fe078 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:10.045244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 878/1749] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:10.093631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ba2a-7dfb-46da-b974-64649bafd669 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:10.094996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ba2a-7dfb-46da-b974-64649bafd669 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:10.095877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ba2a-7dfb-46da-b974-64649bafd669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:10.259598 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:10.283477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e862ba2a-7dfb-46da-b974-64649bafd669 None None] MFA Rules not processed for user `4a31e0a8824e44c288526ddd0b750394`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:10.288445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e862ba2a-7dfb-46da-b974-64649bafd669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:10.490864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3db0d-2622-4ae8-9b7e-2def3f2829bd None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:10.491838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3db0d-2622-4ae8-9b7e-2def3f2829bd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:10.493146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3db0d-2622-4ae8-9b7e-2def3f2829bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:10.619467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 872/1750] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:10.654215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cdc3db0d-2622-4ae8-9b7e-2def3f2829bd None None] MFA Rules not processed for user `b9ece518ba544f5190bb914ccb3fe63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:10.660699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cdc3db0d-2622-4ae8-9b7e-2def3f2829bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:10.847659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:11.058906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 879/1751] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 572 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:11.707119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862ba2a-7dfb-46da-b974-64649bafd669 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:11.709544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e862ba2a-7dfb-46da-b974-64649bafd669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:11.747194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862ba2a-7dfb-46da-b974-64649bafd669 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:11.772276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:11.773459 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:11.773753 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:11.774038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] PATH_INFO: `/v3/projects/f3729700c9fd4e6f8196f7251d99bfcf` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:11.776841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3729700c9fd4e6f8196f7251d99bfcf)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:11.779014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:11.940727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3729700c9fd4e6f8196f7251d99bfcf', 'request_id': 'req-8ebf5f3f-f300-4286-843c-f64c5521dde6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:11.958224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3729700c9fd4e6f8196f7251d99bfcf', 'request_id': 'req-8ebf5f3f-f300-4286-843c-f64c5521dde6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:11.973525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3729700c9fd4e6f8196f7251d99bfcf', 'request_id': 'req-8ebf5f3f-f300-4286-843c-f64c5521dde6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:11.998724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] The token cache is being invalidate because project f3729700c9fd4e6f8196f7251d99bfcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:11.999279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:12.001670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:12.005054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 873/1752] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:11 2022] DELETE /identity/v3/projects/f3729700c9fd4e6f8196f7251d99bfcf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:12.008914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3db0d-2622-4ae8-9b7e-2def3f2829bd None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:12.030676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3db0d-2622-4ae8-9b7e-2def3f2829bd None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:12.156580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:12.166029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:12.323143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:12.330820 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:12.333109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:12.335215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] PATH_INFO: `/v3/users/cfdc35451c5d4cc9b8e74d59ef57824d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:12.337963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdc35451c5d4cc9b8e74d59ef57824d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:12.344368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:12.373634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5f3f-f300-4286-843c-f64c5521dde6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:12.391571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:12.394585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:12.394940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:12.395469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:12.401148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:12.493126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:12.518776 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdc35451c5d4cc9b8e74d59ef57824d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:12.521445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdc35451c5d4cc9b8e74d59ef57824d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:12.524823 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdc35451c5d4cc9b8e74d59ef57824d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:12.597542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdc35451c5d4cc9b8e74d59ef57824d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:12.608828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdc35451c5d4cc9b8e74d59ef57824d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:12.650849 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 880/1753] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:12 2022] DELETE /identity/v3/users/cfdc35451c5d4cc9b8e74d59ef57824d => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:12.651964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:12.653299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:12.656736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:12.657120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:12.689874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 874/1754] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:12.694099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:12.697322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:12.743742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe37cf-c5ad-4bdd-b92c-3cdd8a5bb64f service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:12.824458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:12.877241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bb752-1c90-484c-8d6d-51ea7d5efac9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:12.900317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:12.909028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:12.911673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:12.914300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] PATH_INFO: `/v3/users/c08e6c2c7f824fd9857faa1d87858df6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:12.921218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08e6c2c7f824fd9857faa1d87858df6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:12.927781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:12.960229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:12.963623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:12.964563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:12.965871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] PATH_INFO: `/v3/users/6769dffb08504b97be70bde1a8a5f736` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:12.971600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6769dffb08504b97be70bde1a8a5f736)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:12.976103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:13.050370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08e6c2c7f824fd9857faa1d87858df6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.053167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08e6c2c7f824fd9857faa1d87858df6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.054272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08e6c2c7f824fd9857faa1d87858df6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.087487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08e6c2c7f824fd9857faa1d87858df6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.105781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08e6c2c7f824fd9857faa1d87858df6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.122314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6769dffb08504b97be70bde1a8a5f736'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.131042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 881/1755] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:12 2022] DELETE /identity/v3/users/c08e6c2c7f824fd9857faa1d87858df6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:13.132977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:13.140042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:13.151316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6769dffb08504b97be70bde1a8a5f736'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.182010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6769dffb08504b97be70bde1a8a5f736'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.199322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6769dffb08504b97be70bde1a8a5f736'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.203639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7cf6cc6c-7ca3-45b1-ba75-960ca873bce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6769dffb08504b97be70bde1a8a5f736'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:13.223347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 875/1756] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:12 2022] DELETE /identity/v3/users/6769dffb08504b97be70bde1a8a5f736 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:13.229498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aff9b-d0c4-439c-ac72-d05b65d72906 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:13.229894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aff9b-d0c4-439c-ac72-d05b65d72906 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:13.230635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aff9b-d0c4-439c-ac72-d05b65d72906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:13.279739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d24aff9b-d0c4-439c-ac72-d05b65d72906 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:13.283661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d24aff9b-d0c4-439c-ac72-d05b65d72906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:13.329397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14f71-022a-46a2-9c65-0fa188afff0e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:13.406714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:13.501194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:13.502149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:13.503095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:13.504076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:13.505709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 876/1757] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:13.512696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:13.519925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f70f7b-24e8-4d18-b2df-2ed3ea00feb6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:13.521343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f70f7b-24e8-4d18-b2df-2ed3ea00feb6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:13.522207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f70f7b-24e8-4d18-b2df-2ed3ea00feb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:13.536545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:13.581489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-35f70f7b-24e8-4d18-b2df-2ed3ea00feb6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:13.582902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-35f70f7b-24e8-4d18-b2df-2ed3ea00feb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:13.596381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 877/1758] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:13.597233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f70f7b-24e8-4d18-b2df-2ed3ea00feb6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:13.598653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-35f70f7b-24e8-4d18-b2df-2ed3ea00feb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:13.690619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:13.692953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:13.728502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 882/1759] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:13.737452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:13.741970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:13.858957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f70f7b-24e8-4d18-b2df-2ed3ea00feb6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:13.875308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f11153-4f7d-4c44-9efe-33b95e6db178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:13.876337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11153-4f7d-4c44-9efe-33b95e6db178 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:13.876337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11153-4f7d-4c44-9efe-33b95e6db178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:13.876573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11153-4f7d-4c44-9efe-33b95e6db178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:13.919053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f11153-4f7d-4c44-9efe-33b95e6db178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:13.920620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f11153-4f7d-4c44-9efe-33b95e6db178 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:13.963251 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 878/1760] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:13.982712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434164a-51a9-4b99-8492-e021992cc09d service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:13.989426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcac06b-f08a-4972-85af-94351c26c9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:13.990322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcac06b-f08a-4972-85af-94351c26c9bc service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:13.991737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcac06b-f08a-4972-85af-94351c26c9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:13.992302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcac06b-f08a-4972-85af-94351c26c9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:14.032016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcac06b-f08a-4972-85af-94351c26c9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:14.043413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcac06b-f08a-4972-85af-94351c26c9bc service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:14.099940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 883/1761] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:15.676705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faca61-5273-4008-a274-042f8b9fa1f2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:15.678466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faca61-5273-4008-a274-042f8b9fa1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:15.678466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faca61-5273-4008-a274-042f8b9fa1f2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:15.679124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 879/1762] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:28:16.048666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d68dc-fd8f-435c-abf4-53967c75852f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:16.049814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d68dc-fd8f-435c-abf4-53967c75852f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:16.050254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d68dc-fd8f-435c-abf4-53967c75852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:16.137914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6e7d68dc-fd8f-435c-abf4-53967c75852f None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:16.139411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6e7d68dc-fd8f-435c-abf4-53967c75852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:16.201888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 884/1763] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:28:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:16.465638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faca61-5273-4008-a274-042f8b9fa1f2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:16.468007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c4faca61-5273-4008-a274-042f8b9fa1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:16.538391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faca61-5273-4008-a274-042f8b9fa1f2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:16.552773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:16.556912 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:16.557208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:16.557520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] PATH_INFO: `/v3/projects/1ae1f04de9de4943a3389febfd1d1db6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:16.563384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae1f04de9de4943a3389febfd1d1db6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:16.568499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:16.900406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d68dc-fd8f-435c-abf4-53967c75852f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:16.904353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6e7d68dc-fd8f-435c-abf4-53967c75852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:16.921755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae1f04de9de4943a3389febfd1d1db6', 'request_id': 'req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:16.927435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d68dc-fd8f-435c-abf4-53967c75852f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:16.949437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae1f04de9de4943a3389febfd1d1db6', 'request_id': 'req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:16.968865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae1f04de9de4943a3389febfd1d1db6', 'request_id': 'req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:17.012834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] The token cache is being invalidate because project 1ae1f04de9de4943a3389febfd1d1db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:17.013428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:17.015443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e35b1cbf-cba8-44a1-8f50-9c4dac0aead4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:17.020364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 880/1764] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:16 2022] DELETE /identity/v3/projects/1ae1f04de9de4943a3389febfd1d1db6 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:17.037234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101350-e554-4c73-80d6-06fe0788ec14 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:17.037984 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101350-e554-4c73-80d6-06fe0788ec14 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:17.038566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101350-e554-4c73-80d6-06fe0788ec14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:17.197497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46912195-6221-4668-8846-f3efecb606d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:17.199116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912195-6221-4668-8846-f3efecb606d2 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:17.199673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912195-6221-4668-8846-f3efecb606d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:17.200197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912195-6221-4668-8846-f3efecb606d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:17.207940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-46912195-6221-4668-8846-f3efecb606d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:17.256325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46912195-6221-4668-8846-f3efecb606d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:17.258171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46912195-6221-4668-8846-f3efecb606d2 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:17.283424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 885/1765] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:17.296912 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-58101350-e554-4c73-80d6-06fe0788ec14 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:17.303867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-58101350-e554-4c73-80d6-06fe0788ec14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:17.609790 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bf074-f432-4aba-a0bb-d9da623d4de6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:17.610054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bf074-f432-4aba-a0bb-d9da623d4de6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:17.610897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bf074-f432-4aba-a0bb-d9da623d4de6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:17.613422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 886/1766] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:28:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:28:17.633340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9001e-1a3d-4fab-97c9-863212417b14 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:17.633664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9001e-1a3d-4fab-97c9-863212417b14 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:17.634002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9001e-1a3d-4fab-97c9-863212417b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:17.643645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 881/1767] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 611 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:17.700118 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-63e9001e-1a3d-4fab-97c9-863212417b14 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:17.701426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-63e9001e-1a3d-4fab-97c9-863212417b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:17.745640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101350-e554-4c73-80d6-06fe0788ec14 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:17.749383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 887/1768] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:17.751311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:17.787051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101350-e554-4c73-80d6-06fe0788ec14 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:17.799581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab9c32-63ca-405d-b41a-9ba4cb89f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:17.801111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab9c32-63ca-405d-b41a-9ba4cb89f62c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:17.805443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab9c32-63ca-405d-b41a-9ba4cb89f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:17.806904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab9c32-63ca-405d-b41a-9ba4cb89f62c admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:17.811625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab9c32-63ca-405d-b41a-9ba4cb89f62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:28:17.814961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab9c32-63ca-405d-b41a-9ba4cb89f62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:17.820019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab9c32-63ca-405d-b41a-9ba4cb89f62c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:17.843099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 882/1769] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:28:17.847410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9001e-1a3d-4fab-97c9-863212417b14 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:17.855369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfb9f6-d9f1-49a7-b4be-13774a743142 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:17.855657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfb9f6-d9f1-49a7-b4be-13774a743142 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:17.855933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfb9f6-d9f1-49a7-b4be-13774a743142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:17.864066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9001e-1a3d-4fab-97c9-863212417b14 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:17.883551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419f8d-d8bc-4c84-81bb-03e0b77bf6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:17.886285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419f8d-d8bc-4c84-81bb-03e0b77bf6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:17.886578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419f8d-d8bc-4c84-81bb-03e0b77bf6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:17.886862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419f8d-d8bc-4c84-81bb-03e0b77bf6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:17.887557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e419f8d-d8bc-4c84-81bb-03e0b77bf6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:17.902259 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e419f8d-d8bc-4c84-81bb-03e0b77bf6f9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:17.945276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-24bfb9f6-d9f1-49a7-b4be-13774a743142 None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:17.975517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-24bfb9f6-d9f1-49a7-b4be-13774a743142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:18.005116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:18.024790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 883/1770] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:18.032340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 888/1771] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:17 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:28:18.037667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfb9f6-d9f1-49a7-b4be-13774a743142 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:18.078732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfb9f6-d9f1-49a7-b4be-13774a743142 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:18.187691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1e5fc-f4c3-4763-b4a5-9130d00b20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:18.188417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1e5fc-f4c3-4763-b4a5-9130d00b20d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:18.188842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1e5fc-f4c3-4763-b4a5-9130d00b20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:18.189169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1e5fc-f4c3-4763-b4a5-9130d00b20d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:18.190016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1e5fc-f4c3-4763-b4a5-9130d00b20d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:18.192136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1e5fc-f4c3-4763-b4a5-9130d00b20d4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:18.226980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 884/1772] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:18 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:18.232500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419f8d-d8bc-4c84-81bb-03e0b77bf6f9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:18.258921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419f8d-d8bc-4c84-81bb-03e0b77bf6f9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:18.267135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259047a7-30ea-4e93-8288-b3991218321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:18.267815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259047a7-30ea-4e93-8288-b3991218321f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:18.268266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259047a7-30ea-4e93-8288-b3991218321f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:18.268742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259047a7-30ea-4e93-8288-b3991218321f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:18.270904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259047a7-30ea-4e93-8288-b3991218321f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:18.273599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259047a7-30ea-4e93-8288-b3991218321f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:18.296711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 889/1773] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:18.300614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1e5fc-f4c3-4763-b4a5-9130d00b20d4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:18.324862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1e5fc-f4c3-4763-b4a5-9130d00b20d4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:18.348624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b60a8-b0c6-4ae9-9b86-4bfefcaec281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:18.350701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b60a8-b0c6-4ae9-9b86-4bfefcaec281 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:18.351074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b60a8-b0c6-4ae9-9b86-4bfefcaec281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:18.353663 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b60a8-b0c6-4ae9-9b86-4bfefcaec281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:18.357748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b60a8-b0c6-4ae9-9b86-4bfefcaec281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:18.364547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b60a8-b0c6-4ae9-9b86-4bfefcaec281 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:18.398927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 885/1774] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:18.402654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259047a7-30ea-4e93-8288-b3991218321f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:18.421859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259047a7-30ea-4e93-8288-b3991218321f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:18.446901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3c62-8d9a-47b4-9887-7384d86288c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:18.447695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3c62-8d9a-47b4-9887-7384d86288c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:18.447990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3c62-8d9a-47b4-9887-7384d86288c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:18.448271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3c62-8d9a-47b4-9887-7384d86288c6 admin admin] PATH_INFO: `/v3/projects/9b9fc9750cde4f089f3dee8e51d7dba2/users/1d55ec85aa25458da36c84c75481eb05/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:18.489489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c3c62-8d9a-47b4-9887-7384d86288c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9fc9750cde4f089f3dee8e51d7dba2, user_id=1d55ec85aa25458da36c84c75481eb05, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:18.493380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c3c62-8d9a-47b4-9887-7384d86288c6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:18.523328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 890/1775] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:18 2022] PUT /identity/v3/projects/9b9fc9750cde4f089f3dee8e51d7dba2/users/1d55ec85aa25458da36c84c75481eb05/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:18.536735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14582c0a-d33f-401e-ada4-d49530fe89c5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:18.537030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14582c0a-d33f-401e-ada4-d49530fe89c5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:18.537347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14582c0a-d33f-401e-ada4-d49530fe89c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:18.601541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-14582c0a-d33f-401e-ada4-d49530fe89c5 None None] MFA Rules not processed for user `1d55ec85aa25458da36c84c75481eb05`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:18.602883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-14582c0a-d33f-401e-ada4-d49530fe89c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:18.729104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 886/1776] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:18.734911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3c62-8d9a-47b4-9887-7384d86288c6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:18.845578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14582c0a-d33f-401e-ada4-d49530fe89c5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:18.847476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-14582c0a-d33f-401e-ada4-d49530fe89c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:18.905174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3c62-8d9a-47b4-9887-7384d86288c6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:18.919512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e2b48-9e65-40e4-9899-78900762959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:18.919512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2b48-9e65-40e4-9899-78900762959d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:18.921633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2b48-9e65-40e4-9899-78900762959d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:18.922081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2b48-9e65-40e4-9899-78900762959d admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:18.932013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e2b48-9e65-40e4-9899-78900762959d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:18.938173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e2b48-9e65-40e4-9899-78900762959d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:19.019192 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 891/1777] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:18 2022] POST /identity/v3/projects => generated 379 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:19.021893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e2b48-9e65-40e4-9899-78900762959d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:19.050686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:19.126584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14582c0a-d33f-401e-ada4-d49530fe89c5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:19.234984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e2b48-9e65-40e4-9899-78900762959d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:19.262734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d40c9-2cbb-436f-ac0d-23e96d721569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:19.266498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d40c9-2cbb-436f-ac0d-23e96d721569 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:19.267006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d40c9-2cbb-436f-ac0d-23e96d721569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:19.267505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d40c9-2cbb-436f-ac0d-23e96d721569 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:19.272491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d40c9-2cbb-436f-ac0d-23e96d721569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:19.279069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d40c9-2cbb-436f-ac0d-23e96d721569 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:19.292011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63178d04-81fe-459a-b85d-f2f8332cdfb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:19.292678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63178d04-81fe-459a-b85d-f2f8332cdfb6 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:19.293066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63178d04-81fe-459a-b85d-f2f8332cdfb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:19.293232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63178d04-81fe-459a-b85d-f2f8332cdfb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:19.317489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63178d04-81fe-459a-b85d-f2f8332cdfb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:19.319234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63178d04-81fe-459a-b85d-f2f8332cdfb6 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:19.350696 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 887/1778] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:19.360051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 892/1779] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:19 2022] POST /identity/v3/users => generated 296 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:19.360218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcc960-e3aa-4bce-a7f3-ff7c5920ba57 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:19.360218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcc960-e3aa-4bce-a7f3-ff7c5920ba57 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:19.360218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcc960-e3aa-4bce-a7f3-ff7c5920ba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:19.361448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d40c9-2cbb-436f-ac0d-23e96d721569 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:19.383468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d40c9-2cbb-436f-ac0d-23e96d721569 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:19.398752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee5982-bc93-4952-871b-4388cd54fe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:19.399826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee5982-bc93-4952-871b-4388cd54fe0e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:19.400175 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee5982-bc93-4952-871b-4388cd54fe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:19.400526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee5982-bc93-4952-871b-4388cd54fe0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:19.401379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee5982-bc93-4952-871b-4388cd54fe0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:19.404897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee5982-bc93-4952-871b-4388cd54fe0e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:19.438255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 893/1780] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:19.441450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee5982-bc93-4952-871b-4388cd54fe0e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:19.448736 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9fdcc960-e3aa-4bce-a7f3-ff7c5920ba57 None None] MFA Rules not processed for user `d9934866496945b7bdebd7e7e78c24b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:19.450941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9fdcc960-e3aa-4bce-a7f3-ff7c5920ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:19.480992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee5982-bc93-4952-871b-4388cd54fe0e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:19.492792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857bd2d-9ad7-4a10-8604-0d20cccaa91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:19.493883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857bd2d-9ad7-4a10-8604-0d20cccaa91c admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:19.494607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857bd2d-9ad7-4a10-8604-0d20cccaa91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:19.495070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857bd2d-9ad7-4a10-8604-0d20cccaa91c admin admin] PATH_INFO: `/v3/projects/02d725cfe9744f44bbdddfbfe2a5896c/users/a0a338cd0b844bebb5a00a846ba3d561/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:19.536959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857bd2d-9ad7-4a10-8604-0d20cccaa91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d725cfe9744f44bbdddfbfe2a5896c, user_id=a0a338cd0b844bebb5a00a846ba3d561, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:19.540854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857bd2d-9ad7-4a10-8604-0d20cccaa91c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:19.571007 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 894/1781] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:19 2022] PUT /identity/v3/projects/02d725cfe9744f44bbdddfbfe2a5896c/users/a0a338cd0b844bebb5a00a846ba3d561/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:19.575697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857bd2d-9ad7-4a10-8604-0d20cccaa91c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:19.586152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:19.593342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 888/1782] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:19.800644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857bd2d-9ad7-4a10-8604-0d20cccaa91c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:19.821001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887663-c6f7-463f-9cb7-0d830914f7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:19.822236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887663-c6f7-463f-9cb7-0d830914f7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:19.822739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887663-c6f7-463f-9cb7-0d830914f7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:19.823296 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887663-c6f7-463f-9cb7-0d830914f7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:19.837103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7887663-c6f7-463f-9cb7-0d830914f7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:19.839628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7887663-c6f7-463f-9cb7-0d830914f7c1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:19.864878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 895/1783] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:19.869787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887663-c6f7-463f-9cb7-0d830914f7c1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:19.870234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcc960-e3aa-4bce-a7f3-ff7c5920ba57 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:19.871992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9fdcc960-e3aa-4bce-a7f3-ff7c5920ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:19.907343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887663-c6f7-463f-9cb7-0d830914f7c1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:19.923414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293dfc-50bb-4a53-b92f-c213503f7d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:19.924312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293dfc-50bb-4a53-b92f-c213503f7d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:19.924692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293dfc-50bb-4a53-b92f-c213503f7d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:19.925070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293dfc-50bb-4a53-b92f-c213503f7d7e admin admin] PATH_INFO: `/v3/projects/02d725cfe9744f44bbdddfbfe2a5896c/users/a0a338cd0b844bebb5a00a846ba3d561/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:19.928807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcc960-e3aa-4bce-a7f3-ff7c5920ba57 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:19.930246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29293dfc-50bb-4a53-b92f-c213503f7d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d725cfe9744f44bbdddfbfe2a5896c, user_id=a0a338cd0b844bebb5a00a846ba3d561, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:19.936173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29293dfc-50bb-4a53-b92f-c213503f7d7e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:19.959918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:19.964974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:19.968363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:19.969423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] PATH_INFO: `/v3/projects/828699514cb04d1994d28802fc3b179d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:19.970269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 896/1784] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:19 2022] PUT /identity/v3/projects/02d725cfe9744f44bbdddfbfe2a5896c/users/a0a338cd0b844bebb5a00a846ba3d561/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:19.980515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=828699514cb04d1994d28802fc3b179d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:19.982826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843371fc-4908-494d-b91d-62d74f9f0881 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:19.983269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843371fc-4908-494d-b91d-62d74f9f0881 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:19.983806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843371fc-4908-494d-b91d-62d74f9f0881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:19.986094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:20.083919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-843371fc-4908-494d-b91d-62d74f9f0881 None None] MFA Rules not processed for user `a0a338cd0b844bebb5a00a846ba3d561`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:20.086509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-843371fc-4908-494d-b91d-62d74f9f0881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:20.169327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828699514cb04d1994d28802fc3b179d', 'request_id': 'req-28821685-0bc8-4acb-9c12-e60f929404e7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.199081 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828699514cb04d1994d28802fc3b179d', 'request_id': 'req-28821685-0bc8-4acb-9c12-e60f929404e7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.227483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828699514cb04d1994d28802fc3b179d', 'request_id': 'req-28821685-0bc8-4acb-9c12-e60f929404e7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.277605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] The token cache is being invalidate because project 828699514cb04d1994d28802fc3b179d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:20.278253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.279248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.282243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 889/1785] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:19 2022] DELETE /identity/v3/projects/828699514cb04d1994d28802fc3b179d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:20.283190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:20.285308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:20.297447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:20.357439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 897/1786] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:20.360791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843371fc-4908-494d-b91d-62d74f9f0881 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:20.363103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-843371fc-4908-494d-b91d-62d74f9f0881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:20.452038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28821685-0bc8-4acb-9c12-e60f929404e7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:20.461962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:20.461962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:20.461962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:20.461962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] PATH_INFO: `/v3/projects/6d014f2ccdaa47b6bc079a6eea0a47f0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:20.465226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d014f2ccdaa47b6bc079a6eea0a47f0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:20.472874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:20.534650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843371fc-4908-494d-b91d-62d74f9f0881 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:20.546137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:20.547076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:20.549543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:20.549888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] PATH_INFO: `/v3/users/da7f25fee8f745ae8359ee5d8aef1ada` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:20.552212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7f25fee8f745ae8359ee5d8aef1ada)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:20.557820 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:20.599014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:20.627067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d014f2ccdaa47b6bc079a6eea0a47f0', 'request_id': 'req-83de12fc-150c-4a72-9817-42af43c87fd5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.650821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d014f2ccdaa47b6bc079a6eea0a47f0', 'request_id': 'req-83de12fc-150c-4a72-9817-42af43c87fd5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.656283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7f25fee8f745ae8359ee5d8aef1ada'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.656992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7f25fee8f745ae8359ee5d8aef1ada'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.657644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7f25fee8f745ae8359ee5d8aef1ada'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.669053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d014f2ccdaa47b6bc079a6eea0a47f0', 'request_id': 'req-83de12fc-150c-4a72-9817-42af43c87fd5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.690045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7f25fee8f745ae8359ee5d8aef1ada'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.700729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7f25fee8f745ae8359ee5d8aef1ada'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.709957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] The token cache is being invalidate because project 6d014f2ccdaa47b6bc079a6eea0a47f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:20.710776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.713487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.726222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 890/1787] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:20 2022] DELETE /identity/v3/projects/6d014f2ccdaa47b6bc079a6eea0a47f0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:20.734174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:20.739550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:20.744342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 898/1788] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:20 2022] DELETE /identity/v3/users/da7f25fee8f745ae8359ee5d8aef1ada => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:20.745585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:20.748560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:20.875095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2792-9ffd-4100-9b10-dcc6366d48f8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:20.888024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:20.889311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:20.889613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:20.889891 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] PATH_INFO: `/v3/users/ad5aed9426ec44f7b302bccfde9fdf79` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:20.891317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5aed9426ec44f7b302bccfde9fdf79)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:20.895402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:20.990701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5aed9426ec44f7b302bccfde9fdf79'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.992380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5aed9426ec44f7b302bccfde9fdf79'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:20.994430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5aed9426ec44f7b302bccfde9fdf79'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:21.002075 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de12fc-150c-4a72-9817-42af43c87fd5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:21.039238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5aed9426ec44f7b302bccfde9fdf79'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:21.060508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0bbe6acb-eaf9-45d7-bb35-091776db20cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5aed9426ec44f7b302bccfde9fdf79'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:21.103514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 899/1789] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:20 2022] DELETE /identity/v3/users/ad5aed9426ec44f7b302bccfde9fdf79 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:21.203299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:21.212721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba042ea5-ddeb-4003-bc21-e3d86cc09cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:21.215150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042ea5-ddeb-4003-bc21-e3d86cc09cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:21.218228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042ea5-ddeb-4003-bc21-e3d86cc09cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:21.218678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042ea5-ddeb-4003-bc21-e3d86cc09cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:21.223137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba042ea5-ddeb-4003-bc21-e3d86cc09cd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:21.382639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba042ea5-ddeb-4003-bc21-e3d86cc09cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:21.385991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba042ea5-ddeb-4003-bc21-e3d86cc09cd2 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:21.417111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 891/1790] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:23.072959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711922c8-c7c7-4ce6-80ab-f64e50759169 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:23.073556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711922c8-c7c7-4ce6-80ab-f64e50759169 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:23.073801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711922c8-c7c7-4ce6-80ab-f64e50759169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:23.090521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8ece-37f8-4f64-ba74-4c182ba7ea32 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:23.090960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8ece-37f8-4f64-ba74-4c182ba7ea32 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:23.091218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8ece-37f8-4f64-ba74-4c182ba7ea32 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:23.092749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 892/1791] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 26 07:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:28:23.106223 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-711922c8-c7c7-4ce6-80ab-f64e50759169 None None] MFA Rules not processed for user `b9ece518ba544f5190bb914ccb3fe63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:23.108133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-711922c8-c7c7-4ce6-80ab-f64e50759169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:23.109182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3bb3f-9efe-463a-b973-4caaf72f4ffe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:23.109490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3bb3f-9efe-463a-b973-4caaf72f4ffe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:23.109770 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3bb3f-9efe-463a-b973-4caaf72f4ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:23.116436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:23.142445 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-62a3bb3f-9efe-463a-b973-4caaf72f4ffe None None] MFA Rules not processed for user `7eab2497edff4c968030b5b0d6814150`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:23.144005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-62a3bb3f-9efe-463a-b973-4caaf72f4ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:23.300060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 893/1792] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:28:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:23.351259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3bb3f-9efe-463a-b973-4caaf72f4ffe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:23.352702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-62a3bb3f-9efe-463a-b973-4caaf72f4ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:23.369518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 900/1793] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:23.446608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3bb3f-9efe-463a-b973-4caaf72f4ffe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:23.463139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8408103-ddda-4548-bb49-a44a5526a592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:23.463895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8408103-ddda-4548-bb49-a44a5526a592 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:23.464257 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8408103-ddda-4548-bb49-a44a5526a592 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:23.464488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8408103-ddda-4548-bb49-a44a5526a592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:23.467695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a8408103-ddda-4548-bb49-a44a5526a592 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:23.515823 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711922c8-c7c7-4ce6-80ab-f64e50759169 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:23.518378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-711922c8-c7c7-4ce6-80ab-f64e50759169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:23.568044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711922c8-c7c7-4ce6-80ab-f64e50759169 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:23.592524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e796-dcc4-4392-be20-a8b6c9733a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:23.621718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e796-dcc4-4392-be20-a8b6c9733a9a service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:23.622309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e796-dcc4-4392-be20-a8b6c9733a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:23.622774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e796-dcc4-4392-be20-a8b6c9733a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:23.659742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500e796-dcc4-4392-be20-a8b6c9733a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:23.665213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500e796-dcc4-4392-be20-a8b6c9733a9a service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:23.719300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8408103-ddda-4548-bb49-a44a5526a592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:23.719453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 901/1794] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:23.720841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e796-dcc4-4392-be20-a8b6c9733a9a service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:23.721106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8408103-ddda-4548-bb49-a44a5526a592 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:23.726763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3500e796-dcc4-4392-be20-a8b6c9733a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:23.744857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 894/1795] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:23.897951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e796-dcc4-4392-be20-a8b6c9733a9a service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:23.916930 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:23.918538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:23.918978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:23.919403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] PATH_INFO: `/v3/projects/1d1f8df768054d8a9697ab6b24b1f044` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:23.927263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1f8df768054d8a9697ab6b24b1f044)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:23.936092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:24.116423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1f8df768054d8a9697ab6b24b1f044', 'request_id': 'req-9814277f-c5ff-475e-9a24-0d14f28d762f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:24.135514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1f8df768054d8a9697ab6b24b1f044', 'request_id': 'req-9814277f-c5ff-475e-9a24-0d14f28d762f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:24.158257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1f8df768054d8a9697ab6b24b1f044', 'request_id': 'req-9814277f-c5ff-475e-9a24-0d14f28d762f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:24.181445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] The token cache is being invalidate because project 1d1f8df768054d8a9697ab6b24b1f044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:24.181790 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:24.183334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9814277f-c5ff-475e-9a24-0d14f28d762f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:24.188591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 902/1796] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:23 2022] DELETE /identity/v3/projects/1d1f8df768054d8a9697ab6b24b1f044 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:24.194273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8d6b-8d4b-4921-9762-14b7f65dd27c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:24.196331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8d6b-8d4b-4921-9762-14b7f65dd27c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:24.197926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8d6b-8d4b-4921-9762-14b7f65dd27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:24.227885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:24.260915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f0ea8d6b-8d4b-4921-9762-14b7f65dd27c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:24.264797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f0ea8d6b-8d4b-4921-9762-14b7f65dd27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:24.449580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 895/1797] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:24.452086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab549b-d3b0-468a-9700-b67561b62cd9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:24.452578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab549b-d3b0-468a-9700-b67561b62cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:24.453419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab549b-d3b0-468a-9700-b67561b62cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:24.483831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6aab549b-d3b0-468a-9700-b67561b62cd9 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:24.486672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6aab549b-d3b0-468a-9700-b67561b62cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:24.500250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 903/1798] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:24.505952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8d6b-8d4b-4921-9762-14b7f65dd27c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:24.524578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8d6b-8d4b-4921-9762-14b7f65dd27c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:24.540100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84532212-bbd0-4056-b12c-3fdaa2dd2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:24.541180 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84532212-bbd0-4056-b12c-3fdaa2dd2be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:24.541670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84532212-bbd0-4056-b12c-3fdaa2dd2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:24.542191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84532212-bbd0-4056-b12c-3fdaa2dd2be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:24.543381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84532212-bbd0-4056-b12c-3fdaa2dd2be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:28:24.543886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84532212-bbd0-4056-b12c-3fdaa2dd2be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:24.545999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84532212-bbd0-4056-b12c-3fdaa2dd2be0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:24.572034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 896/1799] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:28:24.573054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab549b-d3b0-468a-9700-b67561b62cd9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:24.584842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab549b-d3b0-468a-9700-b67561b62cd9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:24.593143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b1d54-2034-43d4-857b-dfc5fc4733fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:24.593143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b1d54-2034-43d4-857b-dfc5fc4733fb admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:24.593143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b1d54-2034-43d4-857b-dfc5fc4733fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:24.593143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b1d54-2034-43d4-857b-dfc5fc4733fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:24.594300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b1d54-2034-43d4-857b-dfc5fc4733fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:24.596203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b1d54-2034-43d4-857b-dfc5fc4733fb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:24.640514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 904/1800] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:24 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:28:24.646669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84532212-bbd0-4056-b12c-3fdaa2dd2be0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:24.686474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84532212-bbd0-4056-b12c-3fdaa2dd2be0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:24.859626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d73b02-b72e-4a16-8bf0-986826ff6d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:24.860750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d73b02-b72e-4a16-8bf0-986826ff6d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:24.861252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d73b02-b72e-4a16-8bf0-986826ff6d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:24.861764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d73b02-b72e-4a16-8bf0-986826ff6d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:24.863123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d73b02-b72e-4a16-8bf0-986826ff6d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:24.867485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d73b02-b72e-4a16-8bf0-986826ff6d8f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:24.920237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b1d54-2034-43d4-857b-dfc5fc4733fb admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:24.920558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 897/1801] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:24 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:24.932013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:24.941142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b1d54-2034-43d4-857b-dfc5fc4733fb admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:24.954752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1d51c-fc09-4099-a96f-2d620ac5f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:24.956308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1d51c-fc09-4099-a96f-2d620ac5f6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:24.957029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1d51c-fc09-4099-a96f-2d620ac5f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:24.958889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1d51c-fc09-4099-a96f-2d620ac5f6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:24.959862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1d51c-fc09-4099-a96f-2d620ac5f6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:24.962041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1d51c-fc09-4099-a96f-2d620ac5f6ba admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:24.983116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 905/1802] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:28:24.985849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d73b02-b72e-4a16-8bf0-986826ff6d8f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:25.009066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d73b02-b72e-4a16-8bf0-986826ff6d8f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:25.021549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6ceed-7706-4d58-8f88-210c2daa2572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:25.023297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6ceed-7706-4d58-8f88-210c2daa2572 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:25.024076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6ceed-7706-4d58-8f88-210c2daa2572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:25.025689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6ceed-7706-4d58-8f88-210c2daa2572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:25.027680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6ceed-7706-4d58-8f88-210c2daa2572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:25.031390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6ceed-7706-4d58-8f88-210c2daa2572 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:25.065489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 898/1803] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:25.070781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1d51c-fc09-4099-a96f-2d620ac5f6ba admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:25.088540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1d51c-fc09-4099-a96f-2d620ac5f6ba admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:25.096028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ac8bb-988d-4770-aabc-3703b95b1dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:25.097535 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ac8bb-988d-4770-aabc-3703b95b1dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:25.097844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ac8bb-988d-4770-aabc-3703b95b1dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:25.098100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ac8bb-988d-4770-aabc-3703b95b1dc8 admin admin] PATH_INFO: `/v3/projects/7ca931fe8e0645b5b1b79c9ecaed023c/users/7cb2651629674fefab3286df16210647/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:25.137821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ac8bb-988d-4770-aabc-3703b95b1dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca931fe8e0645b5b1b79c9ecaed023c, user_id=7cb2651629674fefab3286df16210647, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:25.141408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ac8bb-988d-4770-aabc-3703b95b1dc8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:25.165403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 906/1804] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:25 2022] PUT /identity/v3/projects/7ca931fe8e0645b5b1b79c9ecaed023c/users/7cb2651629674fefab3286df16210647/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:25.183499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf64e-1e68-4614-a049-fbbb224f3c7c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:25.183973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf64e-1e68-4614-a049-fbbb224f3c7c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:25.189299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf64e-1e68-4614-a049-fbbb224f3c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:25.258657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-304bf64e-1e68-4614-a049-fbbb224f3c7c None None] MFA Rules not processed for user `7cb2651629674fefab3286df16210647`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:25.261408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-304bf64e-1e68-4614-a049-fbbb224f3c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:25.476422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:25.492710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 899/1805] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:25.496219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ac8bb-988d-4770-aabc-3703b95b1dc8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:25.697053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ac8bb-988d-4770-aabc-3703b95b1dc8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:25.714875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c80c8f-894b-4528-af95-f7009e2a21d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:25.719077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80c8f-894b-4528-af95-f7009e2a21d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:25.721893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80c8f-894b-4528-af95-f7009e2a21d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:25.722739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80c8f-894b-4528-af95-f7009e2a21d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:25.725664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c80c8f-894b-4528-af95-f7009e2a21d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:25.727778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c80c8f-894b-4528-af95-f7009e2a21d4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:25.788088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 907/1806] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:25 2022] POST /identity/v3/projects => generated 379 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:25.794705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf64e-1e68-4614-a049-fbbb224f3c7c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:25.834093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf64e-1e68-4614-a049-fbbb224f3c7c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:26.001960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f57ad-c870-4361-9608-9f2b44a8d244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:26.002862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f57ad-c870-4361-9608-9f2b44a8d244 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.003213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f57ad-c870-4361-9608-9f2b44a8d244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.003493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f57ad-c870-4361-9608-9f2b44a8d244 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.004261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f57ad-c870-4361-9608-9f2b44a8d244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:26.006609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f57ad-c870-4361-9608-9f2b44a8d244 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:26.053129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 900/1807] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:25 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:26.058336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c80c8f-894b-4528-af95-f7009e2a21d4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:26.096606 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c80c8f-894b-4528-af95-f7009e2a21d4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:26.115276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa8af5-020e-4bb1-af04-07dae92ec6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:26.116424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa8af5-020e-4bb1-af04-07dae92ec6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.116913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa8af5-020e-4bb1-af04-07dae92ec6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.118943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa8af5-020e-4bb1-af04-07dae92ec6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.124950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa8af5-020e-4bb1-af04-07dae92ec6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:26.132747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa8af5-020e-4bb1-af04-07dae92ec6a4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:26.152401 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 908/1808] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:26.157458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f57ad-c870-4361-9608-9f2b44a8d244 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:26.177045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f57ad-c870-4361-9608-9f2b44a8d244 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:26.191469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3367a10-6994-40cf-8f3b-16de94f328de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:26.192536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3367a10-6994-40cf-8f3b-16de94f328de admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.193047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3367a10-6994-40cf-8f3b-16de94f328de admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.193551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3367a10-6994-40cf-8f3b-16de94f328de admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.194528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3367a10-6994-40cf-8f3b-16de94f328de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:26.198730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3367a10-6994-40cf-8f3b-16de94f328de admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:26.225992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 901/1809] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:26.230574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa8af5-020e-4bb1-af04-07dae92ec6a4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:26.246852 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3367a10-6994-40cf-8f3b-16de94f328de admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:26.248757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa8af5-020e-4bb1-af04-07dae92ec6a4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:26.251092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3367a10-6994-40cf-8f3b-16de94f328de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:26.266195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d16107-8f32-49e9-8f5e-efc06f5390a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:26.267936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16107-8f32-49e9-8f5e-efc06f5390a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.268298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16107-8f32-49e9-8f5e-efc06f5390a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.268639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16107-8f32-49e9-8f5e-efc06f5390a3 admin admin] PATH_INFO: `/v3/projects/58597185a402470c88b48c0866e5ef41/users/8c7f049f4fdd4181b99bdfad6f3eb91f/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.279430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3367a10-6994-40cf-8f3b-16de94f328de admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:26.295692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:26.296526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.296880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.297232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] PATH_INFO: `/v3/projects/da8fd454cee64613ad3bcacf2f6644bd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.299444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8fd454cee64613ad3bcacf2f6644bd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:26.302645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:26.304006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d16107-8f32-49e9-8f5e-efc06f5390a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58597185a402470c88b48c0866e5ef41, user_id=8c7f049f4fdd4181b99bdfad6f3eb91f, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:26.306975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d16107-8f32-49e9-8f5e-efc06f5390a3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:26.337684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 909/1810] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:26 2022] PUT /identity/v3/projects/58597185a402470c88b48c0866e5ef41/users/8c7f049f4fdd4181b99bdfad6f3eb91f/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:28:26.363399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b989-f0d4-488c-b637-bd53490ec8c3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.363743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b989-f0d4-488c-b637-bd53490ec8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.366462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b989-f0d4-488c-b637-bd53490ec8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.406671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8fd454cee64613ad3bcacf2f6644bd', 'request_id': 'req-cde4230a-045c-4a49-9326-b6b2d3edfb3a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:26.427131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8fd454cee64613ad3bcacf2f6644bd', 'request_id': 'req-cde4230a-045c-4a49-9326-b6b2d3edfb3a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:26.450368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8fd454cee64613ad3bcacf2f6644bd', 'request_id': 'req-cde4230a-045c-4a49-9326-b6b2d3edfb3a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:26.469964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] The token cache is being invalidate because project da8fd454cee64613ad3bcacf2f6644bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:26.470510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:26.471409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cde4230a-045c-4a49-9326-b6b2d3edfb3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:26.473959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 902/1811] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:26 2022] DELETE /identity/v3/projects/da8fd454cee64613ad3bcacf2f6644bd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:26.480621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-56a1b989-f0d4-488c-b637-bd53490ec8c3 None None] MFA Rules not processed for user `8c7f049f4fdd4181b99bdfad6f3eb91f`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:26.481668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1826d0-22e6-4817-8232-57bb22fd0628 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.482007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1826d0-22e6-4817-8232-57bb22fd0628 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.482296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1826d0-22e6-4817-8232-57bb22fd0628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.482954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-56a1b989-f0d4-488c-b637-bd53490ec8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:26.537688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-be1826d0-22e6-4817-8232-57bb22fd0628 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:26.539927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-be1826d0-22e6-4817-8232-57bb22fd0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:26.682596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 910/1812] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:26.684047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:26.694477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b989-f0d4-488c-b637-bd53490ec8c3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:26.698705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-56a1b989-f0d4-488c-b637-bd53490ec8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:26.719946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 903/1813] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:26.726720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0fe43-cbdb-4698-85ef-3020cd0a9da2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.727254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0fe43-cbdb-4698-85ef-3020cd0a9da2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.727254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0fe43-cbdb-4698-85ef-3020cd0a9da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.741758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b989-f0d4-488c-b637-bd53490ec8c3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:26.758539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907cda5-be5b-45eb-8b25-43da4b699743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:26.759726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907cda5-be5b-45eb-8b25-43da4b699743 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.760494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907cda5-be5b-45eb-8b25-43da4b699743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.761032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907cda5-be5b-45eb-8b25-43da4b699743 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.762538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907cda5-be5b-45eb-8b25-43da4b699743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:26.765602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5bd0fe43-cbdb-4698-85ef-3020cd0a9da2 None None] MFA Rules not processed for user `4a31e0a8824e44c288526ddd0b750394`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:26.767260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907cda5-be5b-45eb-8b25-43da4b699743 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:26.767809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5bd0fe43-cbdb-4698-85ef-3020cd0a9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:26.788806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:26.850182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 911/1814] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:26 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:26.850182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e2661-11f3-49d4-bcc9-e88a44336873 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:26.850560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e2661-11f3-49d4-bcc9-e88a44336873 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:26.850910 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e2661-11f3-49d4-bcc9-e88a44336873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:26.880099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a29e2661-11f3-49d4-bcc9-e88a44336873 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:26.881843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a29e2661-11f3-49d4-bcc9-e88a44336873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:26.922270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 904/1815] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:26.923844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0fe43-cbdb-4698-85ef-3020cd0a9da2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:26.955183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0fe43-cbdb-4698-85ef-3020cd0a9da2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.010538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 912/1816] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:27.015241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e2661-11f3-49d4-bcc9-e88a44336873 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.033156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e2661-11f3-49d4-bcc9-e88a44336873 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.055767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d906-ee3a-4670-805c-26d509ba19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.057619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d906-ee3a-4670-805c-26d509ba19b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.058455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d906-ee3a-4670-805c-26d509ba19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.058867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d906-ee3a-4670-805c-26d509ba19b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.063075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d906-ee3a-4670-805c-26d509ba19b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:28:27.063645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d906-ee3a-4670-805c-26d509ba19b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.073343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d906-ee3a-4670-805c-26d509ba19b8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.098129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 913/1817] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:28:27.104361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d906-ee3a-4670-805c-26d509ba19b8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.128625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d906-ee3a-4670-805c-26d509ba19b8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.139351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dc32a-fc90-4f29-a983-b9002414186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.141992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dc32a-fc90-4f29-a983-b9002414186e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.142946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dc32a-fc90-4f29-a983-b9002414186e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.143657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dc32a-fc90-4f29-a983-b9002414186e admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.145488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dc32a-fc90-4f29-a983-b9002414186e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.146123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12fa0-8ea1-46c1-ac2e-dc686a775eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.147446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12fa0-8ea1-46c1-ac2e-dc686a775eab admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.148106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12fa0-8ea1-46c1-ac2e-dc686a775eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.148726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12fa0-8ea1-46c1-ac2e-dc686a775eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.150804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee12fa0-8ea1-46c1-ac2e-dc686a775eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.151372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dc32a-fc90-4f29-a983-b9002414186e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.155160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee12fa0-8ea1-46c1-ac2e-dc686a775eab admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.200974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 905/1818] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:26 2022] POST /identity/v3/users => generated 296 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:27.203810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dc32a-fc90-4f29-a983-b9002414186e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.229865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 914/1819] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:27 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:27.232440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dc32a-fc90-4f29-a983-b9002414186e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.238002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12fa0-8ea1-46c1-ac2e-dc686a775eab admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.360802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dd72a-9d73-4d1e-a526-492f7f9ee40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.361910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dd72a-9d73-4d1e-a526-492f7f9ee40d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.362413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dd72a-9d73-4d1e-a526-492f7f9ee40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.366139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dd72a-9d73-4d1e-a526-492f7f9ee40d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.367181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dd72a-9d73-4d1e-a526-492f7f9ee40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.369218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dd72a-9d73-4d1e-a526-492f7f9ee40d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.391014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12fa0-8ea1-46c1-ac2e-dc686a775eab admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.395562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 906/1820] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:27.401370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dd72a-9d73-4d1e-a526-492f7f9ee40d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.402474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cea20-d385-4b8d-abe5-6fa249415a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.403236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cea20-d385-4b8d-abe5-6fa249415a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.403602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cea20-d385-4b8d-abe5-6fa249415a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.403948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cea20-d385-4b8d-abe5-6fa249415a8a admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.404786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cea20-d385-4b8d-abe5-6fa249415a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.407039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cea20-d385-4b8d-abe5-6fa249415a8a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.427552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dd72a-9d73-4d1e-a526-492f7f9ee40d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.433676 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ded702-c7d0-461e-80c6-a15cc2893a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.434412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded702-c7d0-461e-80c6-a15cc2893a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.434746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded702-c7d0-461e-80c6-a15cc2893a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.434982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded702-c7d0-461e-80c6-a15cc2893a6c admin admin] PATH_INFO: `/v3/projects/abc588ba711647619f888ea51e4670b4/users/6be8d1b97db04c7da473ec71c04d41ea/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.461321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 915/1821] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:27 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:27.463022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cea20-d385-4b8d-abe5-6fa249415a8a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.466301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ded702-c7d0-461e-80c6-a15cc2893a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc588ba711647619f888ea51e4670b4, user_id=6be8d1b97db04c7da473ec71c04d41ea, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.469748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ded702-c7d0-461e-80c6-a15cc2893a6c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.497080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 907/1822] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:27 2022] PUT /identity/v3/projects/abc588ba711647619f888ea51e4670b4/users/6be8d1b97db04c7da473ec71c04d41ea/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:27.502950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ded702-c7d0-461e-80c6-a15cc2893a6c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.506541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cea20-d385-4b8d-abe5-6fa249415a8a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.539637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:27.685726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:27.731586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac738e0-d087-4dcb-9aaf-f73f35a11305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.732282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac738e0-d087-4dcb-9aaf-f73f35a11305 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.732479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ded702-c7d0-461e-80c6-a15cc2893a6c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.732666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac738e0-d087-4dcb-9aaf-f73f35a11305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.733302 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac738e0-d087-4dcb-9aaf-f73f35a11305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.735521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac738e0-d087-4dcb-9aaf-f73f35a11305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.737546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac738e0-d087-4dcb-9aaf-f73f35a11305 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.760231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5ecf5-0cb9-4bb2-9d3c-f01b39d6fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.761388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ecf5-0cb9-4bb2-9d3c-f01b39d6fe2f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.761889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ecf5-0cb9-4bb2-9d3c-f01b39d6fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.764546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ecf5-0cb9-4bb2-9d3c-f01b39d6fe2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.767426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 916/1823] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:27.768698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac738e0-d087-4dcb-9aaf-f73f35a11305 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.771933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5ecf5-0cb9-4bb2-9d3c-f01b39d6fe2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.784063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac738e0-d087-4dcb-9aaf-f73f35a11305 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.787300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5ecf5-0cb9-4bb2-9d3c-f01b39d6fe2f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.795890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9011d36-ca82-4dfc-89fb-7012df83101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.796748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9011d36-ca82-4dfc-89fb-7012df83101f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.797034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9011d36-ca82-4dfc-89fb-7012df83101f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.798400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9011d36-ca82-4dfc-89fb-7012df83101f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.799462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9011d36-ca82-4dfc-89fb-7012df83101f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.803374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9011d36-ca82-4dfc-89fb-7012df83101f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.835873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 917/1824] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:27.838268 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9011d36-ca82-4dfc-89fb-7012df83101f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.844042 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 908/1825] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:27.852730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5ecf5-0cb9-4bb2-9d3c-f01b39d6fe2f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:27.858706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9011d36-ca82-4dfc-89fb-7012df83101f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.865469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a6fb3-be94-4342-8687-b79b5f584df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.866841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a6fb3-be94-4342-8687-b79b5f584df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.867916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a6fb3-be94-4342-8687-b79b5f584df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.867916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a6fb3-be94-4342-8687-b79b5f584df0 admin admin] PATH_INFO: `/v3/projects/7ca7d1cb31ba46eaa9fe661a8bbbd9c0/users/ff36b118874e4cee8f5332e00c9886db/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.908619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5ecf5-0cb9-4bb2-9d3c-f01b39d6fe2f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:27.919612 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a6fb3-be94-4342-8687-b79b5f584df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca7d1cb31ba46eaa9fe661a8bbbd9c0, user_id=ff36b118874e4cee8f5332e00c9886db, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.925894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a6fb3-be94-4342-8687-b79b5f584df0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.932626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6603d82-e92f-45e0-9acc-7f0a11aac2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:27.934385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603d82-e92f-45e0-9acc-7f0a11aac2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.935385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603d82-e92f-45e0-9acc-7f0a11aac2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.936397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603d82-e92f-45e0-9acc-7f0a11aac2be admin admin] PATH_INFO: `/v3/projects/abc588ba711647619f888ea51e4670b4/users/6be8d1b97db04c7da473ec71c04d41ea/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:27.949568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6603d82-e92f-45e0-9acc-7f0a11aac2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc588ba711647619f888ea51e4670b4, user_id=6be8d1b97db04c7da473ec71c04d41ea, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:27.961159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 918/1826] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:27 2022] PUT /identity/v3/projects/7ca7d1cb31ba46eaa9fe661a8bbbd9c0/users/ff36b118874e4cee8f5332e00c9886db/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:27.973568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6603d82-e92f-45e0-9acc-7f0a11aac2be admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:27.982435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1175a-2cf1-47c8-8274-63d1845676c8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:27.983276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1175a-2cf1-47c8-8274-63d1845676c8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:27.984026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1175a-2cf1-47c8-8274-63d1845676c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:28.029886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 909/1827] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:27 2022] PUT /identity/v3/projects/abc588ba711647619f888ea51e4670b4/users/6be8d1b97db04c7da473ec71c04d41ea/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:28.031504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d0613-ad2c-40e0-8ca6-ea31b11fcb55 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:28.031792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d0613-ad2c-40e0-8ca6-ea31b11fcb55 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:28.032066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d0613-ad2c-40e0-8ca6-ea31b11fcb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:28.039670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-00a1175a-2cf1-47c8-8274-63d1845676c8 None None] MFA Rules not processed for user `ff36b118874e4cee8f5332e00c9886db`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:28.042146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-00a1175a-2cf1-47c8-8274-63d1845676c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:28.160697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dd7d0613-ad2c-40e0-8ca6-ea31b11fcb55 None None] MFA Rules not processed for user `6be8d1b97db04c7da473ec71c04d41ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:28.183773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dd7d0613-ad2c-40e0-8ca6-ea31b11fcb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:28.214101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 919/1828] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:28.217508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de988-6b9a-4f5e-9bd1-e696d4e2a73b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:28.218150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de988-6b9a-4f5e-9bd1-e696d4e2a73b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:28.218750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de988-6b9a-4f5e-9bd1-e696d4e2a73b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:28.222092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 920/1829] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:28:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:28:28.223732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9de988-6b9a-4f5e-9bd1-e696d4e2a73b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:28.426869 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 910/1830] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:28.445335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96d818-2362-457b-b6d9-9e69f48cd7d0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:28.445335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96d818-2362-457b-b6d9-9e69f48cd7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:28.445763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96d818-2362-457b-b6d9-9e69f48cd7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:28.522222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6a96d818-2362-457b-b6d9-9e69f48cd7d0 None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:28.524497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6a96d818-2362-457b-b6d9-9e69f48cd7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:28.539874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9de988-6b9a-4f5e-9bd1-e696d4e2a73b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:28.550825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14ac4-e1a6-4076-9239-ec9a7ec6a244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:28.552386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14ac4-e1a6-4076-9239-ec9a7ec6a244 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:28.553016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14ac4-e1a6-4076-9239-ec9a7ec6a244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:28.553894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14ac4-e1a6-4076-9239-ec9a7ec6a244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:28.555886 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14ac4-e1a6-4076-9239-ec9a7ec6a244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:28.560159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14ac4-e1a6-4076-9239-ec9a7ec6a244 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:28.666247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 921/1831] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:28 2022] POST /identity/v3/projects => generated 377 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:28.668252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14ac4-e1a6-4076-9239-ec9a7ec6a244 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:28.675166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ffc14ac4-e1a6-4076-9239-ec9a7ec6a244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:28.771266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:28.779983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 911/1832] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:28:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:28.781852 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96d818-2362-457b-b6d9-9e69f48cd7d0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:28.809379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96d818-2362-457b-b6d9-9e69f48cd7d0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:28.822976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:28.889310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14ac4-e1a6-4076-9239-ec9a7ec6a244 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:28.897824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81064-40d4-4ac9-8bed-77a8384ae91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:28.899204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81064-40d4-4ac9-8bed-77a8384ae91e service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:28.899836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81064-40d4-4ac9-8bed-77a8384ae91e service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:28.900436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81064-40d4-4ac9-8bed-77a8384ae91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:28.986496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30c779-680f-4026-84e9-f655c340259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:28.987703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30c779-680f-4026-84e9-f655c340259a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:28.988169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30c779-680f-4026-84e9-f655c340259a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:28.988943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30c779-680f-4026-84e9-f655c340259a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:28.996360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30c779-680f-4026-84e9-f655c340259a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:29.006818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30c779-680f-4026-84e9-f655c340259a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:29.098598 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 912/1833] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:28 2022] POST /identity/v3/users => generated 295 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:29.101506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30c779-680f-4026-84e9-f655c340259a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:29.105175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5a30c779-680f-4026-84e9-f655c340259a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:29.160691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30c779-680f-4026-84e9-f655c340259a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:29.173646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:29.174426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d81064-40d4-4ac9-8bed-77a8384ae91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:29.174922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:29.175421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:29.175897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] PATH_INFO: `/v3/users/1d55ec85aa25458da36c84c75481eb05` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:29.176679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d81064-40d4-4ac9-8bed-77a8384ae91e service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:29.178562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d55ec85aa25458da36c84c75481eb05)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:29.185407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:29.192215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 922/1834] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:29.193646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81064-40d4-4ac9-8bed-77a8384ae91e service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:29.209340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81064-40d4-4ac9-8bed-77a8384ae91e service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:29.215297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaadc0-bf28-427a-ab37-49768c7d7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:29.217140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaadc0-bf28-427a-ab37-49768c7d7b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:29.217736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaadc0-bf28-427a-ab37-49768c7d7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:29.218361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaadc0-bf28-427a-ab37-49768c7d7b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:29.220564 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaadc0-bf28-427a-ab37-49768c7d7b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:29.223120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaadc0-bf28-427a-ab37-49768c7d7b6b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:29.249306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 923/1835] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:29.253513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaadc0-bf28-427a-ab37-49768c7d7b6b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:29.291011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaadc0-bf28-427a-ab37-49768c7d7b6b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:29.302109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d864eca-3d71-4206-8a61-84c952103f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:29.302977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d864eca-3d71-4206-8a61-84c952103f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:29.303260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d864eca-3d71-4206-8a61-84c952103f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:29.303544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d864eca-3d71-4206-8a61-84c952103f29 admin admin] PATH_INFO: `/v3/projects/db2b40ce1f6f4a75bd3f89692c0fce83/users/f891b43619764a34a34901d22f7d1118/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:29.361352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d864eca-3d71-4206-8a61-84c952103f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2b40ce1f6f4a75bd3f89692c0fce83, user_id=f891b43619764a34a34901d22f7d1118, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:29.365516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d864eca-3d71-4206-8a61-84c952103f29 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:29.404385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 924/1836] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:29 2022] PUT /identity/v3/projects/db2b40ce1f6f4a75bd3f89692c0fce83/users/f891b43619764a34a34901d22f7d1118/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:29.405503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d864eca-3d71-4206-8a61-84c952103f29 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:29.408958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2d864eca-3d71-4206-8a61-84c952103f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:29.427573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d55ec85aa25458da36c84c75481eb05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:29.443106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d55ec85aa25458da36c84c75481eb05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:29.464113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d55ec85aa25458da36c84c75481eb05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:29.480992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d55ec85aa25458da36c84c75481eb05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:29.483955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d55ec85aa25458da36c84c75481eb05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:29.498860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 913/1837] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:29 2022] DELETE /identity/v3/users/1d55ec85aa25458da36c84c75481eb05 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:29.500291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d864eca-3d71-4206-8a61-84c952103f29 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:29.501876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:29.505137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:29.675968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:29.695377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84dfd-e4c7-4257-9f5d-11d567606654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:29.696061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84dfd-e4c7-4257-9f5d-11d567606654 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:29.696561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84dfd-e4c7-4257-9f5d-11d567606654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:29.697171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84dfd-e4c7-4257-9f5d-11d567606654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:29.702193 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e5b84dfd-e4c7-4257-9f5d-11d567606654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:29.769709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcfb85-1e0e-4ca2-8702-32ac3dd8ec92 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:29.792204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae49a36-f7f9-4d5b-a8db-76790c9655f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:29.795577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae49a36-f7f9-4d5b-a8db-76790c9655f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:29.795926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae49a36-f7f9-4d5b-a8db-76790c9655f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:29.800220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae49a36-f7f9-4d5b-a8db-76790c9655f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:29.801310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae49a36-f7f9-4d5b-a8db-76790c9655f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:29.811033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae49a36-f7f9-4d5b-a8db-76790c9655f5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:29.865388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 914/1838] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:29.868165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb22e4-2d19-4e83-b27a-e26990ff6034 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:29.881485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb22e4-2d19-4e83-b27a-e26990ff6034 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:29.882091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb22e4-2d19-4e83-b27a-e26990ff6034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:29.957907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:29.963250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b84dfd-e4c7-4257-9f5d-11d567606654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:29.972565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b84dfd-e4c7-4257-9f5d-11d567606654 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:29.993008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0edb22e4-2d19-4e83-b27a-e26990ff6034 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:29.994735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0edb22e4-2d19-4e83-b27a-e26990ff6034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:30.015023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 925/1839] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:30.016745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84dfd-e4c7-4257-9f5d-11d567606654 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:30.025577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 915/1840] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:30.025577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb22e4-2d19-4e83-b27a-e26990ff6034 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:30.031349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0edb22e4-2d19-4e83-b27a-e26990ff6034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:30.085574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84dfd-e4c7-4257-9f5d-11d567606654 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:30.104936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a46b5b-2928-463e-8006-b8f0480afc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:30.106755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a46b5b-2928-463e-8006-b8f0480afc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:30.108580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a46b5b-2928-463e-8006-b8f0480afc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:30.109158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a46b5b-2928-463e-8006-b8f0480afc38 admin admin] PATH_INFO: `/v3/projects/db2b40ce1f6f4a75bd3f89692c0fce83/users/f891b43619764a34a34901d22f7d1118/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:30.116032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a46b5b-2928-463e-8006-b8f0480afc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2b40ce1f6f4a75bd3f89692c0fce83, user_id=f891b43619764a34a34901d22f7d1118, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:30.122713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a46b5b-2928-463e-8006-b8f0480afc38 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:30.151561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 926/1841] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:30 2022] PUT /identity/v3/projects/db2b40ce1f6f4a75bd3f89692c0fce83/users/f891b43619764a34a34901d22f7d1118/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:30.170808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a46b5b-2928-463e-8006-b8f0480afc38 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:30.179852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-40a46b5b-2928-463e-8006-b8f0480afc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:30.313831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb22e4-2d19-4e83-b27a-e26990ff6034 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:30.491104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a46b5b-2928-463e-8006-b8f0480afc38 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:30.520358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9493b04-e9ed-412e-bf39-3ce958238c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:30.521227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9493b04-e9ed-412e-bf39-3ce958238c50 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:30.521538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9493b04-e9ed-412e-bf39-3ce958238c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:30.521804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9493b04-e9ed-412e-bf39-3ce958238c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:30.538627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d164-a21e-4d2d-87c6-ea3eb896e9c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:30.539658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d164-a21e-4d2d-87c6-ea3eb896e9c0 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:30.539954 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d164-a21e-4d2d-87c6-ea3eb896e9c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:30.540233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d164-a21e-4d2d-87c6-ea3eb896e9c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:30.542479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5b01d164-a21e-4d2d-87c6-ea3eb896e9c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:30.562499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d164-a21e-4d2d-87c6-ea3eb896e9c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:30.567070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d164-a21e-4d2d-87c6-ea3eb896e9c0 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:30.588114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 916/1842] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:30.590833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba06c1-1cb6-4fb1-adcc-181e805683f7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:30.591126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba06c1-1cb6-4fb1-adcc-181e805683f7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:30.591409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba06c1-1cb6-4fb1-adcc-181e805683f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:30.641772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a0ba06c1-1cb6-4fb1-adcc-181e805683f7 None None] MFA Rules not processed for user `f891b43619764a34a34901d22f7d1118`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:30.643107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a0ba06c1-1cb6-4fb1-adcc-181e805683f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:30.792375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9493b04-e9ed-412e-bf39-3ce958238c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:30.796163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9493b04-e9ed-412e-bf39-3ce958238c50 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:30.853733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 927/1843] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:30.873339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 917/1844] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:30.902191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9493b04-e9ed-412e-bf39-3ce958238c50 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:30.904661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f9493b04-e9ed-412e-bf39-3ce958238c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:31.044081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:31.080406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9493b04-e9ed-412e-bf39-3ce958238c50 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:31.087898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d095298-3f17-4dea-8b30-3c8021d80966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:31.089074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d095298-3f17-4dea-8b30-3c8021d80966 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:31.090182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d095298-3f17-4dea-8b30-3c8021d80966 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:31.090303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d095298-3f17-4dea-8b30-3c8021d80966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:31.095410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4d095298-3f17-4dea-8b30-3c8021d80966 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:31.283772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d095298-3f17-4dea-8b30-3c8021d80966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:31.288083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d095298-3f17-4dea-8b30-3c8021d80966 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:31.311991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 928/1845] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:32.301454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba06c1-1cb6-4fb1-adcc-181e805683f7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:32.304970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a0ba06c1-1cb6-4fb1-adcc-181e805683f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:32.367794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba06c1-1cb6-4fb1-adcc-181e805683f7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:32.382048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:32.390070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:32.390996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:32.391929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] PATH_INFO: `/v3/projects/9b9fc9750cde4f089f3dee8e51d7dba2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:32.396089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9fc9750cde4f089f3dee8e51d7dba2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:32.403446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:32.405819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:32.527205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9fc9750cde4f089f3dee8e51d7dba2', 'request_id': 'req-45054bac-8d36-4abe-ad8f-c062d32640c1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:32.545929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9fc9750cde4f089f3dee8e51d7dba2', 'request_id': 'req-45054bac-8d36-4abe-ad8f-c062d32640c1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:32.566630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9fc9750cde4f089f3dee8e51d7dba2', 'request_id': 'req-45054bac-8d36-4abe-ad8f-c062d32640c1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:32.595380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] The token cache is being invalidate because project 9b9fc9750cde4f089f3dee8e51d7dba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:32.595786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:32.597171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:32.601334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 918/1846] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:32 2022] DELETE /identity/v3/projects/9b9fc9750cde4f089f3dee8e51d7dba2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:32.606943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d095298-3f17-4dea-8b30-3c8021d80966 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:32.631694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d095298-3f17-4dea-8b30-3c8021d80966 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:32.784784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:32.785806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:32.786318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:32.786806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] PATH_INFO: `/v3/users/a0a338cd0b844bebb5a00a846ba3d561` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:32.792915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a338cd0b844bebb5a00a846ba3d561)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:32.796312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:32.974094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a338cd0b844bebb5a00a846ba3d561'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:32.975663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a338cd0b844bebb5a00a846ba3d561'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:32.977191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a338cd0b844bebb5a00a846ba3d561'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:33.008119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a338cd0b844bebb5a00a846ba3d561'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:33.028351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a338cd0b844bebb5a00a846ba3d561'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:33.133037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 929/1847] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:32 2022] DELETE /identity/v3/users/a0a338cd0b844bebb5a00a846ba3d561 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:34.691200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:34.693501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:34.721560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45054bac-8d36-4abe-ad8f-c062d32640c1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:34.927922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:34.931826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:34.938269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:34.938713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:34.939217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:34.939743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] PATH_INFO: `/v3/users/7cb2651629674fefab3286df16210647` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:34.941667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb2651629674fefab3286df16210647)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:34.945703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:34.987266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:35.089061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb2651629674fefab3286df16210647'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.130248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb2651629674fefab3286df16210647'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.158104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc6960-6402-4ffe-a2ce-c6891522a68c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:35.162863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb2651629674fefab3286df16210647'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.183615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76ba05-0a30-4510-b401-f46f79cbc8e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:35.186936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb2651629674fefab3286df16210647'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.187228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ba05-0a30-4510-b401-f46f79cbc8e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:35.187531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ba05-0a30-4510-b401-f46f79cbc8e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:35.188440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb2651629674fefab3286df16210647'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.189204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ba05-0a30-4510-b401-f46f79cbc8e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:35.197432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-df76ba05-0a30-4510-b401-f46f79cbc8e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:35.200857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 919/1848] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:34 2022] DELETE /identity/v3/users/7cb2651629674fefab3286df16210647 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:35.212184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:35.214633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:35.232123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:35.349152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a0fe4-22be-43a1-b48a-07475e3aa33e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:35.357915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:35.362327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:35.363616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:35.364202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] PATH_INFO: `/v3/projects/02d725cfe9744f44bbdddfbfe2a5896c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:35.366113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d725cfe9744f44bbdddfbfe2a5896c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:35.370058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:35.374165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76ba05-0a30-4510-b401-f46f79cbc8e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:35.377782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76ba05-0a30-4510-b401-f46f79cbc8e9 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:35.426475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 930/1849] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:35.428029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc52f8-48e1-46fb-bcc7-c69d27e99964 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:35.428335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc52f8-48e1-46fb-bcc7-c69d27e99964 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:35.428610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc52f8-48e1-46fb-bcc7-c69d27e99964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:35.484321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-68cc52f8-48e1-46fb-bcc7-c69d27e99964 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:35.487266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-68cc52f8-48e1-46fb-bcc7-c69d27e99964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:35.520492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d725cfe9744f44bbdddfbfe2a5896c', 'request_id': 'req-5e5e5991-587d-4f92-a003-fbd77468f506'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.534431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d725cfe9744f44bbdddfbfe2a5896c', 'request_id': 'req-5e5e5991-587d-4f92-a003-fbd77468f506'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.541938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d725cfe9744f44bbdddfbfe2a5896c', 'request_id': 'req-5e5e5991-587d-4f92-a003-fbd77468f506'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.583245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] The token cache is being invalidate because project 02d725cfe9744f44bbdddfbfe2a5896c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:35.583245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.586894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e5e5991-587d-4f92-a003-fbd77468f506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:35.596372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 920/1850] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:35 2022] DELETE /identity/v3/projects/02d725cfe9744f44bbdddfbfe2a5896c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:35.600060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c5b5c-0db2-41f9-8d8d-f60cc4d6a39a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:35.600379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c5b5c-0db2-41f9-8d8d-f60cc4d6a39a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:35.600719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c5b5c-0db2-41f9-8d8d-f60cc4d6a39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:35.648780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f19c5b5c-0db2-41f9-8d8d-f60cc4d6a39a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:35.650845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f19c5b5c-0db2-41f9-8d8d-f60cc4d6a39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:35.672577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 931/1851] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:35.673008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 921/1852] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:35.688308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce94fe-5212-4aac-ae6e-2eb611334afe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:35.688624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce94fe-5212-4aac-ae6e-2eb611334afe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:35.688908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce94fe-5212-4aac-ae6e-2eb611334afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:35.715820 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc52f8-48e1-46fb-bcc7-c69d27e99964 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:35.720371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-68cc52f8-48e1-46fb-bcc7-c69d27e99964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:35.726746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-95ce94fe-5212-4aac-ae6e-2eb611334afe None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:35.728563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-95ce94fe-5212-4aac-ae6e-2eb611334afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:35.747028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 922/1853] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:35.749000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce94fe-5212-4aac-ae6e-2eb611334afe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:35.767308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce94fe-5212-4aac-ae6e-2eb611334afe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:35.775009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4b89-a892-4ea6-b211-578179f71f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:35.775801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4b89-a892-4ea6-b211-578179f71f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:35.776179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4b89-a892-4ea6-b211-578179f71f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:35.776539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4b89-a892-4ea6-b211-578179f71f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:35.777763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4b89-a892-4ea6-b211-578179f71f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:28:35.778158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4b89-a892-4ea6-b211-578179f71f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:35.781110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4b89-a892-4ea6-b211-578179f71f06 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:35.812277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 923/1854] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:28:35.813995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4b89-a892-4ea6-b211-578179f71f06 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:35.831408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4b89-a892-4ea6-b211-578179f71f06 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:35.838971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c698ab-79a7-406c-9bd2-0921b13509fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:35.840080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c698ab-79a7-406c-9bd2-0921b13509fd admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:35.840414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c698ab-79a7-406c-9bd2-0921b13509fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:35.840705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c698ab-79a7-406c-9bd2-0921b13509fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:35.841972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c698ab-79a7-406c-9bd2-0921b13509fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:35.845501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c698ab-79a7-406c-9bd2-0921b13509fd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:35.914114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 924/1855] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:35 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:35.915657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c698ab-79a7-406c-9bd2-0921b13509fd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:36.035208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:36.065299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c698ab-79a7-406c-9bd2-0921b13509fd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:36.076159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5d505-3105-4d75-9c13-0f6464d317ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:36.077121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5d505-3105-4d75-9c13-0f6464d317ac admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:36.078544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5d505-3105-4d75-9c13-0f6464d317ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:36.078949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5d505-3105-4d75-9c13-0f6464d317ac admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:36.080116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5d505-3105-4d75-9c13-0f6464d317ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:36.083886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5d505-3105-4d75-9c13-0f6464d317ac admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:36.133688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 925/1856] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:35 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:36.137283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc52f8-48e1-46fb-bcc7-c69d27e99964 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:36.150789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5d505-3105-4d75-9c13-0f6464d317ac admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:36.197797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5d505-3105-4d75-9c13-0f6464d317ac admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:36.200462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:36.223015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c02e-c3e6-4122-a1cb-098e8948de85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:36.223689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c02e-c3e6-4122-a1cb-098e8948de85 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:36.223975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c02e-c3e6-4122-a1cb-098e8948de85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:36.224253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c02e-c3e6-4122-a1cb-098e8948de85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:36.224983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c02e-c3e6-4122-a1cb-098e8948de85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:36.226689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c02e-c3e6-4122-a1cb-098e8948de85 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:36.246539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 926/1857] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:36.251596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c02e-c3e6-4122-a1cb-098e8948de85 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:36.287879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c02e-c3e6-4122-a1cb-098e8948de85 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:36.298320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75430d65-1f0e-4344-83c2-8389b6f95894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:36.299082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75430d65-1f0e-4344-83c2-8389b6f95894 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:36.299389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75430d65-1f0e-4344-83c2-8389b6f95894 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:36.299660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75430d65-1f0e-4344-83c2-8389b6f95894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:36.302101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91896028-9628-48b8-8ed5-5cbd83ecde0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:36.302791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896028-9628-48b8-8ed5-5cbd83ecde0e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:36.303052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896028-9628-48b8-8ed5-5cbd83ecde0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:36.303329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896028-9628-48b8-8ed5-5cbd83ecde0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:36.304060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91896028-9628-48b8-8ed5-5cbd83ecde0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:36.305755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91896028-9628-48b8-8ed5-5cbd83ecde0e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:36.315695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75430d65-1f0e-4344-83c2-8389b6f95894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:36.318422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75430d65-1f0e-4344-83c2-8389b6f95894 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:36.337879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 927/1858] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:36.342256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91896028-9628-48b8-8ed5-5cbd83ecde0e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:36.353636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 932/1859] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:36.365142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91896028-9628-48b8-8ed5-5cbd83ecde0e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:36.387017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0cf88-a2ff-4ca1-8781-f8cecbcf93b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:36.387747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0cf88-a2ff-4ca1-8781-f8cecbcf93b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:36.388032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0cf88-a2ff-4ca1-8781-f8cecbcf93b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:36.388310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0cf88-a2ff-4ca1-8781-f8cecbcf93b6 admin admin] PATH_INFO: `/v3/projects/efdca505ccaf4085b2fb946514d208ab/users/a21fa57fe1e34f999220a36c8b162dfb/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:36.428015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0cf88-a2ff-4ca1-8781-f8cecbcf93b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdca505ccaf4085b2fb946514d208ab, user_id=a21fa57fe1e34f999220a36c8b162dfb, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:36.440009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0cf88-a2ff-4ca1-8781-f8cecbcf93b6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:36.492026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 928/1860] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:36 2022] PUT /identity/v3/projects/efdca505ccaf4085b2fb946514d208ab/users/a21fa57fe1e34f999220a36c8b162dfb/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:28:36.500204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b38c2-2e4e-4426-a282-3ef2cc7c1b3b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:36.500673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b38c2-2e4e-4426-a282-3ef2cc7c1b3b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:36.501130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b38c2-2e4e-4426-a282-3ef2cc7c1b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:36.569921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-814b38c2-2e4e-4426-a282-3ef2cc7c1b3b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:36.576394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-814b38c2-2e4e-4426-a282-3ef2cc7c1b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:36.730712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 933/1861] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:36.746800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0cf88-a2ff-4ca1-8781-f8cecbcf93b6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:36.749361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-efd0cf88-a2ff-4ca1-8781-f8cecbcf93b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:36.841051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0cf88-a2ff-4ca1-8781-f8cecbcf93b6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:36.846476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863932f0-72c5-48eb-8639-07e0febf8124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:36.847291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863932f0-72c5-48eb-8639-07e0febf8124 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:36.847761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863932f0-72c5-48eb-8639-07e0febf8124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:36.848139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863932f0-72c5-48eb-8639-07e0febf8124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:36.863351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863932f0-72c5-48eb-8639-07e0febf8124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:36.865382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863932f0-72c5-48eb-8639-07e0febf8124 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:36.881821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 929/1862] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:37.264787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b38c2-2e4e-4426-a282-3ef2cc7c1b3b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:37.267703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-814b38c2-2e4e-4426-a282-3ef2cc7c1b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:37.292487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b38c2-2e4e-4426-a282-3ef2cc7c1b3b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:37.306836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:37.309116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:37.309116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:37.309116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] PATH_INFO: `/v3/projects/7ca931fe8e0645b5b1b79c9ecaed023c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:37.311142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca931fe8e0645b5b1b79c9ecaed023c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:37.316717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:37.442188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca931fe8e0645b5b1b79c9ecaed023c', 'request_id': 'req-450bed5c-79b5-4580-903e-3e77c3b6817d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.453158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca931fe8e0645b5b1b79c9ecaed023c', 'request_id': 'req-450bed5c-79b5-4580-903e-3e77c3b6817d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.460854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca931fe8e0645b5b1b79c9ecaed023c', 'request_id': 'req-450bed5c-79b5-4580-903e-3e77c3b6817d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.476471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] The token cache is being invalidate because project 7ca931fe8e0645b5b1b79c9ecaed023c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:37.476819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.477766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.479767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 934/1863] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:37 2022] DELETE /identity/v3/projects/7ca931fe8e0645b5b1b79c9ecaed023c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:37.484378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863932f0-72c5-48eb-8639-07e0febf8124 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:37.499004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863932f0-72c5-48eb-8639-07e0febf8124 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:37.599345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:37.600785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:37.601137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:37.601510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] PATH_INFO: `/v3/users/8c7f049f4fdd4181b99bdfad6f3eb91f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:37.603710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7f049f4fdd4181b99bdfad6f3eb91f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:37.605898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:37.685745 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:37.712685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7f049f4fdd4181b99bdfad6f3eb91f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.732709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7f049f4fdd4181b99bdfad6f3eb91f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.806417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7f049f4fdd4181b99bdfad6f3eb91f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.823888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7f049f4fdd4181b99bdfad6f3eb91f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.830451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7f049f4fdd4181b99bdfad6f3eb91f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:37.839765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 930/1864] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:37 2022] DELETE /identity/v3/users/8c7f049f4fdd4181b99bdfad6f3eb91f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:38.607450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:38.610120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:38.652298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bed5c-79b5-4580-903e-3e77c3b6817d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:38.841434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:38.867380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:38.868176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:38.868525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:38.868929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] PATH_INFO: `/v3/projects/58597185a402470c88b48c0866e5ef41` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:38.873165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=58597185a402470c88b48c0866e5ef41)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:38.875450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:38.993385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58597185a402470c88b48c0866e5ef41', 'request_id': 'req-3470429c-467d-4794-9fc4-13a3494c2f4b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.009992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58597185a402470c88b48c0866e5ef41', 'request_id': 'req-3470429c-467d-4794-9fc4-13a3494c2f4b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.018650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58597185a402470c88b48c0866e5ef41', 'request_id': 'req-3470429c-467d-4794-9fc4-13a3494c2f4b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.035294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] The token cache is being invalidate because project 58597185a402470c88b48c0866e5ef41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:39.036319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.037238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3470429c-467d-4794-9fc4-13a3494c2f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.043397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 935/1865] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:38 2022] DELETE /identity/v3/projects/58597185a402470c88b48c0866e5ef41 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:39.045499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:39.048090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:39.074397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565b332-30a2-4c88-8b25-40d87f5180d9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:39.200476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:39.201711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:39.202022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:39.202440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] PATH_INFO: `/v3/users/6be8d1b97db04c7da473ec71c04d41ea` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:39.218824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be8d1b97db04c7da473ec71c04d41ea)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:39.229760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:39.409676 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be8d1b97db04c7da473ec71c04d41ea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.431060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c52b9-68ec-4db0-bc83-c99d1b1589e2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:39.431273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c52b9-68ec-4db0-bc83-c99d1b1589e2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:39.431859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c52b9-68ec-4db0-bc83-c99d1b1589e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:39.441510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be8d1b97db04c7da473ec71c04d41ea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.508648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be8d1b97db04c7da473ec71c04d41ea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.536618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be8d1b97db04c7da473ec71c04d41ea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.538529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be8d1b97db04c7da473ec71c04d41ea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:39.553440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a49c52b9-68ec-4db0-bc83-c99d1b1589e2 None None] MFA Rules not processed for user `a21fa57fe1e34f999220a36c8b162dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:39.559939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a49c52b9-68ec-4db0-bc83-c99d1b1589e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:39.564194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 931/1866] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:39 2022] DELETE /identity/v3/users/6be8d1b97db04c7da473ec71c04d41ea => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:39.726266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 936/1867] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:39.727602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:39.729800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:39.823540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:39.892306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ca63c-bdc4-4ece-afc7-88bb4b2c3bfd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:39.906117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104c44-e019-4fff-8097-cd2a8cb80682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:39.906775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104c44-e019-4fff-8097-cd2a8cb80682 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:39.907052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104c44-e019-4fff-8097-cd2a8cb80682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:39.907372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104c44-e019-4fff-8097-cd2a8cb80682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:39.908120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2104c44-e019-4fff-8097-cd2a8cb80682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:39.910066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2104c44-e019-4fff-8097-cd2a8cb80682 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:39.960577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 932/1868] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:39 2022] POST /identity/v3/projects => generated 371 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:39.962799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c52b9-68ec-4db0-bc83-c99d1b1589e2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:39.978223 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c52b9-68ec-4db0-bc83-c99d1b1589e2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:40.063183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40540770-f5d7-47c3-90fc-1e0846b86575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:40.064108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540770-f5d7-47c3-90fc-1e0846b86575 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.064374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540770-f5d7-47c3-90fc-1e0846b86575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.064858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540770-f5d7-47c3-90fc-1e0846b86575 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.065947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40540770-f5d7-47c3-90fc-1e0846b86575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:40.068357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40540770-f5d7-47c3-90fc-1e0846b86575 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:40.088413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:40.114105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 937/1869] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:39 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:40.120189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104c44-e019-4fff-8097-cd2a8cb80682 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:40.131602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104c44-e019-4fff-8097-cd2a8cb80682 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:40.137470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506da2b-84f2-4965-bda3-cf0966debf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:40.138145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506da2b-84f2-4965-bda3-cf0966debf10 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.138424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506da2b-84f2-4965-bda3-cf0966debf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.138833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506da2b-84f2-4965-bda3-cf0966debf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.140071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506da2b-84f2-4965-bda3-cf0966debf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:40.141203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506da2b-84f2-4965-bda3-cf0966debf10 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:40.157593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 933/1870] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:40.159462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40540770-f5d7-47c3-90fc-1e0846b86575 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:40.170700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40540770-f5d7-47c3-90fc-1e0846b86575 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:40.176214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5da0e8-a4cf-4c5c-a894-1ce7e3962524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:40.177242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5da0e8-a4cf-4c5c-a894-1ce7e3962524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.177718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5da0e8-a4cf-4c5c-a894-1ce7e3962524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.178078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5da0e8-a4cf-4c5c-a894-1ce7e3962524 admin admin] PATH_INFO: `/v3/projects/f46ca5c544b94a879c704ba13eb5d27d/users/aa6d77b0e2f64040b7334f1933f0dfe9/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.197079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5da0e8-a4cf-4c5c-a894-1ce7e3962524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46ca5c544b94a879c704ba13eb5d27d, user_id=aa6d77b0e2f64040b7334f1933f0dfe9, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:40.200155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5da0e8-a4cf-4c5c-a894-1ce7e3962524 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:40.219077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 938/1871] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:40 2022] PUT /identity/v3/projects/f46ca5c544b94a879c704ba13eb5d27d/users/aa6d77b0e2f64040b7334f1933f0dfe9/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:28:40.223189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506da2b-84f2-4965-bda3-cf0966debf10 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:40.235425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506da2b-84f2-4965-bda3-cf0966debf10 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:40.272673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5da0e8-a4cf-4c5c-a894-1ce7e3962524 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:40.274811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0b5da0e8-a4cf-4c5c-a894-1ce7e3962524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:40.361729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc20c5c-9f4c-4b3f-b798-78e8455a431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:40.362883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc20c5c-9f4c-4b3f-b798-78e8455a431e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.363321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc20c5c-9f4c-4b3f-b798-78e8455a431e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.363883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc20c5c-9f4c-4b3f-b798-78e8455a431e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.364763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc20c5c-9f4c-4b3f-b798-78e8455a431e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:40.367110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc20c5c-9f4c-4b3f-b798-78e8455a431e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:40.384860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 934/1872] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:40.389993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc20c5c-9f4c-4b3f-b798-78e8455a431e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:40.404942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc20c5c-9f4c-4b3f-b798-78e8455a431e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:40.414131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ab984-4730-4bb9-a985-2780a9c95f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:40.415127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ab984-4730-4bb9-a985-2780a9c95f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.416204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ab984-4730-4bb9-a985-2780a9c95f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.416960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ab984-4730-4bb9-a985-2780a9c95f38 admin admin] PATH_INFO: `/v3/projects/f46ca5c544b94a879c704ba13eb5d27d/users/aa6d77b0e2f64040b7334f1933f0dfe9/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.420546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ab984-4730-4bb9-a985-2780a9c95f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46ca5c544b94a879c704ba13eb5d27d, user_id=aa6d77b0e2f64040b7334f1933f0dfe9, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:40.425628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ab984-4730-4bb9-a985-2780a9c95f38 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:40.438837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5da0e8-a4cf-4c5c-a894-1ce7e3962524 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:40.446118 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:40.447078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.447354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.448000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] PATH_INFO: `/v3/projects/abc588ba711647619f888ea51e4670b4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.449090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc588ba711647619f888ea51e4670b4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:40.453187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:40.478920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 935/1873] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:40 2022] PUT /identity/v3/projects/f46ca5c544b94a879c704ba13eb5d27d/users/aa6d77b0e2f64040b7334f1933f0dfe9/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:40.594801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc588ba711647619f888ea51e4670b4', 'request_id': 'req-ca7d9721-6583-44bb-80fb-842568f0850a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:40.613574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc588ba711647619f888ea51e4670b4', 'request_id': 'req-ca7d9721-6583-44bb-80fb-842568f0850a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:40.641188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc588ba711647619f888ea51e4670b4', 'request_id': 'req-ca7d9721-6583-44bb-80fb-842568f0850a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:40.671383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] The token cache is being invalidate because project abc588ba711647619f888ea51e4670b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:40.672211 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:40.673482 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca7d9721-6583-44bb-80fb-842568f0850a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:40.676539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 939/1874] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:40 2022] DELETE /identity/v3/projects/abc588ba711647619f888ea51e4670b4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:40.683557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca6ee3-211b-4fcb-9c86-e70afc996b72 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.684068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca6ee3-211b-4fcb-9c86-e70afc996b72 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.684419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca6ee3-211b-4fcb-9c86-e70afc996b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.713461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f6ca6ee3-211b-4fcb-9c86-e70afc996b72 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:40.714705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f6ca6ee3-211b-4fcb-9c86-e70afc996b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:40.789593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 936/1875] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:40.798237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f48ec-61cc-4b37-ab7f-fd6de0ce1ab0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.798774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f48ec-61cc-4b37-ab7f-fd6de0ce1ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.798774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f48ec-61cc-4b37-ab7f-fd6de0ce1ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.820877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-239f48ec-61cc-4b37-ab7f-fd6de0ce1ab0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:40.822906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-239f48ec-61cc-4b37-ab7f-fd6de0ce1ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:40.834012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 940/1876] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:40.838827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca6ee3-211b-4fcb-9c86-e70afc996b72 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:40.850545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca6ee3-211b-4fcb-9c86-e70afc996b72 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:40.855594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39811c6e-4319-47d4-95a0-647dff7d8a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:40.856336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39811c6e-4319-47d4-95a0-647dff7d8a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.856733 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39811c6e-4319-47d4-95a0-647dff7d8a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.857160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39811c6e-4319-47d4-95a0-647dff7d8a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.858081 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39811c6e-4319-47d4-95a0-647dff7d8a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:28:40.858455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39811c6e-4319-47d4-95a0-647dff7d8a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:40.860167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39811c6e-4319-47d4-95a0-647dff7d8a49 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:40.877388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 937/1877] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:28:40.879199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f48ec-61cc-4b37-ab7f-fd6de0ce1ab0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:40.889509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f48ec-61cc-4b37-ab7f-fd6de0ce1ab0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:40.895547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b5ce3-7adc-4643-b966-3b4255d9c034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:40.896478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b5ce3-7adc-4643-b966-3b4255d9c034 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:40.896976 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b5ce3-7adc-4643-b966-3b4255d9c034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:40.897498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b5ce3-7adc-4643-b966-3b4255d9c034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:40.898205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b5ce3-7adc-4643-b966-3b4255d9c034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:40.900389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b5ce3-7adc-4643-b966-3b4255d9c034 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:40.931423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 941/1878] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:40 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:40.936615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39811c6e-4319-47d4-95a0-647dff7d8a49 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:40.950920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39811c6e-4319-47d4-95a0-647dff7d8a49 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:40.991203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:41.040518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d19a5-8fbb-4458-970c-a2556f8e5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:41.041168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d19a5-8fbb-4458-970c-a2556f8e5d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:41.041505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d19a5-8fbb-4458-970c-a2556f8e5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:41.041780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d19a5-8fbb-4458-970c-a2556f8e5d4d admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:41.042475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d19a5-8fbb-4458-970c-a2556f8e5d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:41.044424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d19a5-8fbb-4458-970c-a2556f8e5d4d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:41.070692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 938/1879] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:40 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:41.076226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b5ce3-7adc-4643-b966-3b4255d9c034 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:41.091039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b5ce3-7adc-4643-b966-3b4255d9c034 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:41.097202 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ce438-c184-47ff-8d54-32b490d64a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:41.097827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ce438-c184-47ff-8d54-32b490d64a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:41.098103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ce438-c184-47ff-8d54-32b490d64a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:41.098431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ce438-c184-47ff-8d54-32b490d64a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:41.099081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ce438-c184-47ff-8d54-32b490d64a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:41.100721 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ce438-c184-47ff-8d54-32b490d64a56 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:41.115971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 942/1880] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:41.118186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d19a5-8fbb-4458-970c-a2556f8e5d4d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:41.152242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d19a5-8fbb-4458-970c-a2556f8e5d4d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:41.157587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44d859-73f7-4283-8154-b060f3ce3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:41.158247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44d859-73f7-4283-8154-b060f3ce3815 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:41.158505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44d859-73f7-4283-8154-b060f3ce3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:41.158765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44d859-73f7-4283-8154-b060f3ce3815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:41.159510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44d859-73f7-4283-8154-b060f3ce3815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:41.161149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44d859-73f7-4283-8154-b060f3ce3815 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:41.179282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 939/1881] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:41.179906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ce438-c184-47ff-8d54-32b490d64a56 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:41.191148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ce438-c184-47ff-8d54-32b490d64a56 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:41.198925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5febf5-8353-4df7-b139-21c7f2ef1b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:41.199880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5febf5-8353-4df7-b139-21c7f2ef1b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:41.200306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5febf5-8353-4df7-b139-21c7f2ef1b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:41.200662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5febf5-8353-4df7-b139-21c7f2ef1b6d admin admin] PATH_INFO: `/v3/projects/c72d31abaa9b4cfd90b00b1babaca90c/users/46e452efbe4a498187e9e2525bcec864/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:41.223110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5febf5-8353-4df7-b139-21c7f2ef1b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72d31abaa9b4cfd90b00b1babaca90c, user_id=46e452efbe4a498187e9e2525bcec864, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:41.227888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5febf5-8353-4df7-b139-21c7f2ef1b6d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:41.242505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:41.255162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 943/1882] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:41 2022] PUT /identity/v3/projects/c72d31abaa9b4cfd90b00b1babaca90c/users/46e452efbe4a498187e9e2525bcec864/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:41.267444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405d330-ab3b-4cef-918e-67dfc562495d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:41.267723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405d330-ab3b-4cef-918e-67dfc562495d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:41.267996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405d330-ab3b-4cef-918e-67dfc562495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:41.315419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4405d330-ab3b-4cef-918e-67dfc562495d None None] MFA Rules not processed for user `46e452efbe4a498187e9e2525bcec864`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:41.317331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4405d330-ab3b-4cef-918e-67dfc562495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:41.453537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 940/1883] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:41.459870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5febf5-8353-4df7-b139-21c7f2ef1b6d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:41.558875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5febf5-8353-4df7-b139-21c7f2ef1b6d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:41.575938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d63093-07e1-486b-b423-fb8bcfa26f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:41.577184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d63093-07e1-486b-b423-fb8bcfa26f85 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:41.577827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d63093-07e1-486b-b423-fb8bcfa26f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:41.578027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d63093-07e1-486b-b423-fb8bcfa26f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:41.578819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d63093-07e1-486b-b423-fb8bcfa26f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:41.582459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d63093-07e1-486b-b423-fb8bcfa26f85 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:41.649832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 944/1884] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:41 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:28:41.659320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405d330-ab3b-4cef-918e-67dfc562495d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:41.690369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405d330-ab3b-4cef-918e-67dfc562495d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:41.814911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ebb11-8854-4155-bce9-84a90e942485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:41.814911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ebb11-8854-4155-bce9-84a90e942485 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:41.814911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ebb11-8854-4155-bce9-84a90e942485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:41.814911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ebb11-8854-4155-bce9-84a90e942485 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:41.815448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ebb11-8854-4155-bce9-84a90e942485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:41.815573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ebb11-8854-4155-bce9-84a90e942485 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:41.851114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 941/1885] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:41 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:41.855974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d63093-07e1-486b-b423-fb8bcfa26f85 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:41.873424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d63093-07e1-486b-b423-fb8bcfa26f85 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:41.881639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbfed2-cfea-4fc8-83ea-c33ecc6f89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:41.892474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbfed2-cfea-4fc8-83ea-c33ecc6f89a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:41.893005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbfed2-cfea-4fc8-83ea-c33ecc6f89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:41.893507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbfed2-cfea-4fc8-83ea-c33ecc6f89a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:41.894538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbfed2-cfea-4fc8-83ea-c33ecc6f89a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:41.897610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbfed2-cfea-4fc8-83ea-c33ecc6f89a1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:41.928882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 945/1886] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:41.935321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ebb11-8854-4155-bce9-84a90e942485 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:41.963571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ebb11-8854-4155-bce9-84a90e942485 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:41.975663 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d653-ac3e-4480-8ccf-a96a5c306e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:41.977642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d653-ac3e-4480-8ccf-a96a5c306e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:41.977642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d653-ac3e-4480-8ccf-a96a5c306e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:41.977642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d653-ac3e-4480-8ccf-a96a5c306e8c admin admin] PATH_INFO: `/v3/projects/78031d5ec1514bcfb3e1208a1e6d1499/users/bea59b3c463b443a95d7bdebbc765e21/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:42.017211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1d653-ac3e-4480-8ccf-a96a5c306e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78031d5ec1514bcfb3e1208a1e6d1499, user_id=bea59b3c463b443a95d7bdebbc765e21, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:42.027051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1d653-ac3e-4480-8ccf-a96a5c306e8c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:42.040595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:42.080511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 942/1887] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:41 2022] PUT /identity/v3/projects/78031d5ec1514bcfb3e1208a1e6d1499/users/bea59b3c463b443a95d7bdebbc765e21/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:42.086572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbfed2-cfea-4fc8-83ea-c33ecc6f89a1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:42.126666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbfed2-cfea-4fc8-83ea-c33ecc6f89a1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:42.367486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88af92-e283-4531-b609-e74c5a93af6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:42.368160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88af92-e283-4531-b609-e74c5a93af6e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:42.368446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88af92-e283-4531-b609-e74c5a93af6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:42.368724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88af92-e283-4531-b609-e74c5a93af6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:42.374280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88af92-e283-4531-b609-e74c5a93af6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:42.376474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88af92-e283-4531-b609-e74c5a93af6e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:42.403316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 946/1888] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:28:42.410844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d653-ac3e-4480-8ccf-a96a5c306e8c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:42.437747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db3d2b-38ca-4944-adfc-29e522afd792 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:42.438037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db3d2b-38ca-4944-adfc-29e522afd792 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:42.438314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db3d2b-38ca-4944-adfc-29e522afd792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:42.441894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d653-ac3e-4480-8ccf-a96a5c306e8c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:42.456419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a093a8-d838-440b-9d47-d3d8835e874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:42.457675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a093a8-d838-440b-9d47-d3d8835e874b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:42.457958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a093a8-d838-440b-9d47-d3d8835e874b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:42.458680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a093a8-d838-440b-9d47-d3d8835e874b admin admin] PATH_INFO: `/v3/projects/78031d5ec1514bcfb3e1208a1e6d1499/users/bea59b3c463b443a95d7bdebbc765e21/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:42.463346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a093a8-d838-440b-9d47-d3d8835e874b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78031d5ec1514bcfb3e1208a1e6d1499, user_id=bea59b3c463b443a95d7bdebbc765e21, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:42.473903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a093a8-d838-440b-9d47-d3d8835e874b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:42.499840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f5db3d2b-38ca-4944-adfc-29e522afd792 None None] MFA Rules not processed for user `aa6d77b0e2f64040b7334f1933f0dfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:42.501187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f5db3d2b-38ca-4944-adfc-29e522afd792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:42.549303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 943/1889] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:42 2022] PUT /identity/v3/projects/78031d5ec1514bcfb3e1208a1e6d1499/users/bea59b3c463b443a95d7bdebbc765e21/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:28:42.554496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861bc9-f0a0-49a5-b5ec-e152bf3b3982 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:42.555196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861bc9-f0a0-49a5-b5ec-e152bf3b3982 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:42.555534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861bc9-f0a0-49a5-b5ec-e152bf3b3982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:42.619873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-df861bc9-f0a0-49a5-b5ec-e152bf3b3982 None None] MFA Rules not processed for user `bea59b3c463b443a95d7bdebbc765e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:42.623278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:42.623675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df861bc9-f0a0-49a5-b5ec-e152bf3b3982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:42.658205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 947/1890] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:42.683842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d6d4-520e-411d-933c-26f01f5a5836 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:42.685068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d6d4-520e-411d-933c-26f01f5a5836 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:42.686378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d6d4-520e-411d-933c-26f01f5a5836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:42.732843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8e98d6d4-520e-411d-933c-26f01f5a5836 None None] MFA Rules not processed for user `a21fa57fe1e34f999220a36c8b162dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:42.735133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8e98d6d4-520e-411d-933c-26f01f5a5836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:42.761565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 944/1891] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:42.774599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861bc9-f0a0-49a5-b5ec-e152bf3b3982 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:42.776064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df861bc9-f0a0-49a5-b5ec-e152bf3b3982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:42.826748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 948/1892] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:42.838575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98d6d4-520e-411d-933c-26f01f5a5836 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:42.841030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8e98d6d4-520e-411d-933c-26f01f5a5836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:42.847874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861bc9-f0a0-49a5-b5ec-e152bf3b3982 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:42.867774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6c77-b795-4531-a371-dced6d4e0aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:42.868718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6c77-b795-4531-a371-dced6d4e0aad service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:42.868998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6c77-b795-4531-a371-dced6d4e0aad service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:42.869301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6c77-b795-4531-a371-dced6d4e0aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:42.879999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d6c77-b795-4531-a371-dced6d4e0aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:42.881693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d6c77-b795-4531-a371-dced6d4e0aad service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:42.894040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 945/1893] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:42.992466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98d6d4-520e-411d-933c-26f01f5a5836 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:43.006685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1f71-4d07-4af1-bf83-d279e9f36db8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:43.006685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1f71-4d07-4af1-bf83-d279e9f36db8 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:43.009337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1f71-4d07-4af1-bf83-d279e9f36db8 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:43.009684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1f71-4d07-4af1-bf83-d279e9f36db8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:43.011798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7b6d1f71-4d07-4af1-bf83-d279e9f36db8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:43.017113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6c77-b795-4531-a371-dced6d4e0aad service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:43.024326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d1f71-4d07-4af1-bf83-d279e9f36db8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:43.026069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d1f71-4d07-4af1-bf83-d279e9f36db8 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:43.028777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6c77-b795-4531-a371-dced6d4e0aad service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:43.034474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f51e60-0d42-4cc7-af7c-d36972bd0645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:43.035561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f51e60-0d42-4cc7-af7c-d36972bd0645 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:43.036057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f51e60-0d42-4cc7-af7c-d36972bd0645 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:43.036431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f51e60-0d42-4cc7-af7c-d36972bd0645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:43.038559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 949/1894] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:43.114466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f51e60-0d42-4cc7-af7c-d36972bd0645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:43.116253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f51e60-0d42-4cc7-af7c-d36972bd0645 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:43.130303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 946/1895] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:48.614086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1f71-4d07-4af1-bf83-d279e9f36db8 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:48.802311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1f71-4d07-4af1-bf83-d279e9f36db8 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:48.808592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:48.809553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:48.809891 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:48.810554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] PATH_INFO: `/v3/users/46e452efbe4a498187e9e2525bcec864` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:48.812815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e452efbe4a498187e9e2525bcec864)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:48.814886 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:48.861433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:48.890164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e452efbe4a498187e9e2525bcec864'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:48.890901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e452efbe4a498187e9e2525bcec864'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:48.891527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e452efbe4a498187e9e2525bcec864'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:48.913743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e452efbe4a498187e9e2525bcec864'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:48.932338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e452efbe4a498187e9e2525bcec864'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:48.962933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 950/1896] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:48 2022] DELETE /identity/v3/users/46e452efbe4a498187e9e2525bcec864 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:28:48.964754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e982-3929-485f-ba23-bf33f14d26ed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:48.965253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e982-3929-485f-ba23-bf33f14d26ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:48.965372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e982-3929-485f-ba23-bf33f14d26ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:48.982559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:48.994245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-36e4e982-3929-485f-ba23-bf33f14d26ed None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:48.995476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-36e4e982-3929-485f-ba23-bf33f14d26ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:49.099107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 947/1897] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:49.144151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:49.145706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:49.256032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc394b-210d-491e-bcfb-e5a5c0a908ab admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:49.260126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe07328-5772-406d-b6d9-e3d876711312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:49.261368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe07328-5772-406d-b6d9-e3d876711312 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:49.261862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe07328-5772-406d-b6d9-e3d876711312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:49.262340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe07328-5772-406d-b6d9-e3d876711312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:49.273533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe07328-5772-406d-b6d9-e3d876711312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:49.275310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe07328-5772-406d-b6d9-e3d876711312 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:49.293749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 951/1898] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:49.688135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4e982-3929-485f-ba23-bf33f14d26ed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:49.689662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-36e4e982-3929-485f-ba23-bf33f14d26ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:49.708296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4e982-3929-485f-ba23-bf33f14d26ed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:49.715244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:49.715944 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:49.716231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:49.716542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] PATH_INFO: `/v3/projects/c72d31abaa9b4cfd90b00b1babaca90c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:49.717913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72d31abaa9b4cfd90b00b1babaca90c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:49.720500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:49.815653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72d31abaa9b4cfd90b00b1babaca90c', 'request_id': 'req-1e6dee38-735c-4d00-9d9e-00b46725c315'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:49.826266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72d31abaa9b4cfd90b00b1babaca90c', 'request_id': 'req-1e6dee38-735c-4d00-9d9e-00b46725c315'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:49.849943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72d31abaa9b4cfd90b00b1babaca90c', 'request_id': 'req-1e6dee38-735c-4d00-9d9e-00b46725c315'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:49.864496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] The token cache is being invalidate because project c72d31abaa9b4cfd90b00b1babaca90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:49.864496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:49.865075 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:49.867107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 948/1899] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:49 2022] DELETE /identity/v3/projects/c72d31abaa9b4cfd90b00b1babaca90c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:49.871217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe07328-5772-406d-b6d9-e3d876711312 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:49.883743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe07328-5772-406d-b6d9-e3d876711312 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:49.976160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:49.976835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:49.977122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:49.977401 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] PATH_INFO: `/v3/users/bea59b3c463b443a95d7bdebbc765e21` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:49.981332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea59b3c463b443a95d7bdebbc765e21)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:49.983548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:50.051761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea59b3c463b443a95d7bdebbc765e21'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.052755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea59b3c463b443a95d7bdebbc765e21'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.053584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea59b3c463b443a95d7bdebbc765e21'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.055620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:50.071310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea59b3c463b443a95d7bdebbc765e21'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.080169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fefae213-9c3e-4ef8-a31a-186ddca393b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea59b3c463b443a95d7bdebbc765e21'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.093102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 952/1900] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:49 2022] DELETE /identity/v3/users/bea59b3c463b443a95d7bdebbc765e21 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:28:50.210107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:50.211924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:50.233528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dee38-735c-4d00-9d9e-00b46725c315 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:50.366220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:50.367212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:50.367503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:50.367775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] PATH_INFO: `/v3/users/ff36b118874e4cee8f5332e00c9886db` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:50.369040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff36b118874e4cee8f5332e00c9886db)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:50.371030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:50.438511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:50.471803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff36b118874e4cee8f5332e00c9886db'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.494873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff36b118874e4cee8f5332e00c9886db'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.519827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff36b118874e4cee8f5332e00c9886db'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.528564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff36b118874e4cee8f5332e00c9886db'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.529857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff36b118874e4cee8f5332e00c9886db'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.542606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 949/1901] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:50 2022] DELETE /identity/v3/users/ff36b118874e4cee8f5332e00c9886db => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:50.544752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dadb6-0b8b-49d7-8652-bee5ccc506fa None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:50.545058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dadb6-0b8b-49d7-8652-bee5ccc506fa None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:50.545396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dadb6-0b8b-49d7-8652-bee5ccc506fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:50.558449 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:50.567959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:50.583059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1a6dadb6-0b8b-49d7-8652-bee5ccc506fa None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:50.587787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1a6dadb6-0b8b-49d7-8652-bee5ccc506fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:50.692138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3429da-99b5-4799-bcf6-45e1c5c6c3a0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:50.704335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:50.705432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:50.705928 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:50.706536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] PATH_INFO: `/v3/projects/78031d5ec1514bcfb3e1208a1e6d1499` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:50.707998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=78031d5ec1514bcfb3e1208a1e6d1499)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:50.710206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:50.720434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 953/1902] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:50.733119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dadb6-0b8b-49d7-8652-bee5ccc506fa None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:50.735580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1a6dadb6-0b8b-49d7-8652-bee5ccc506fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:50.777594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78031d5ec1514bcfb3e1208a1e6d1499', 'request_id': 'req-34e8a83a-aebb-4fa8-a397-909cd012f31f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.788824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78031d5ec1514bcfb3e1208a1e6d1499', 'request_id': 'req-34e8a83a-aebb-4fa8-a397-909cd012f31f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.798896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78031d5ec1514bcfb3e1208a1e6d1499', 'request_id': 'req-34e8a83a-aebb-4fa8-a397-909cd012f31f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.813169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] The token cache is being invalidate because project 78031d5ec1514bcfb3e1208a1e6d1499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:50.813707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.814699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-34e8a83a-aebb-4fa8-a397-909cd012f31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:50.815472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dadb6-0b8b-49d7-8652-bee5ccc506fa None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:50.830938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 950/1903] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:50 2022] DELETE /identity/v3/projects/78031d5ec1514bcfb3e1208a1e6d1499 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:50.836670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ae2b-bf16-4e1a-9113-e54090e7be7f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:50.837037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ae2b-bf16-4e1a-9113-e54090e7be7f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:50.837413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ae2b-bf16-4e1a-9113-e54090e7be7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:50.868943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cf94ae2b-bf16-4e1a-9113-e54090e7be7f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:50.870387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cf94ae2b-bf16-4e1a-9113-e54090e7be7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:50.879947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbfede-55fa-401e-9a63-bb5c05824ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:50.880557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbfede-55fa-401e-9a63-bb5c05824ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:50.880868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbfede-55fa-401e-9a63-bb5c05824ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:50.881109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbfede-55fa-401e-9a63-bb5c05824ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:50.883196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-96fbfede-55fa-401e-9a63-bb5c05824ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:50.916392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:50.927850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:50.967780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 951/1904] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:50.979019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c1433-8307-4c4e-ac63-33c211132700 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:50.979310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c1433-8307-4c4e-ac63-33c211132700 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:50.979585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c1433-8307-4c4e-ac63-33c211132700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.005634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbfede-55fa-401e-9a63-bb5c05824ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.007492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbfede-55fa-401e-9a63-bb5c05824ef8 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.008621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8b1c1433-8307-4c4e-ac63-33c211132700 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:51.010091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8b1c1433-8307-4c4e-ac63-33c211132700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:51.021406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 954/1905] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:51.021836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 952/1906] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:51.026730 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbfede-55fa-401e-9a63-bb5c05824ef8 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.036720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbfede-55fa-401e-9a63-bb5c05824ef8 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:51.059667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8c2a0-342d-4329-9728-ee41ceaee35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:51.061056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8c2a0-342d-4329-9728-ee41ceaee35f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.061523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8c2a0-342d-4329-9728-ee41ceaee35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.062044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8c2a0-342d-4329-9728-ee41ceaee35f admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.063129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8c2a0-342d-4329-9728-ee41ceaee35f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:28:51.063439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8c2a0-342d-4329-9728-ee41ceaee35f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.072758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8c2a0-342d-4329-9728-ee41ceaee35f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.091007 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 955/1907] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:28:51.096310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c1433-8307-4c4e-ac63-33c211132700 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.114147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c1433-8307-4c4e-ac63-33c211132700 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:51.142254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec36cb-bbca-4609-b741-336d5d439ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:51.142953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec36cb-bbca-4609-b741-336d5d439ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.143244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec36cb-bbca-4609-b741-336d5d439ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.143586 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec36cb-bbca-4609-b741-336d5d439ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.144361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec36cb-bbca-4609-b741-336d5d439ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.146614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec36cb-bbca-4609-b741-336d5d439ccb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.215858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 953/1908] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:51 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:51.216830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8c2a0-342d-4329-9728-ee41ceaee35f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.236834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8c2a0-342d-4329-9728-ee41ceaee35f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:51.315785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dfa1a-14fa-4fe8-824b-01dee8602868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:51.317104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dfa1a-14fa-4fe8-824b-01dee8602868 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.317445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dfa1a-14fa-4fe8-824b-01dee8602868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.317733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dfa1a-14fa-4fe8-824b-01dee8602868 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.318511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dfa1a-14fa-4fe8-824b-01dee8602868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.320728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dfa1a-14fa-4fe8-824b-01dee8602868 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.372267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 956/1909] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:51 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:51.373899 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec36cb-bbca-4609-b741-336d5d439ccb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.387776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec36cb-bbca-4609-b741-336d5d439ccb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:51.401475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf4632-6aa4-4307-a05a-8b234914deff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:51.402356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4632-6aa4-4307-a05a-8b234914deff admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.402833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4632-6aa4-4307-a05a-8b234914deff admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.403323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4632-6aa4-4307-a05a-8b234914deff admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.404308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf4632-6aa4-4307-a05a-8b234914deff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.406975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf4632-6aa4-4307-a05a-8b234914deff admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.434472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dfa1a-14fa-4fe8-824b-01dee8602868 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.434727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 954/1910] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:51.449536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dfa1a-14fa-4fe8-824b-01dee8602868 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:51.456857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71b3c-b046-4394-8fbe-7176f9914471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:51.457852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71b3c-b046-4394-8fbe-7176f9914471 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.458568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71b3c-b046-4394-8fbe-7176f9914471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.459328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71b3c-b046-4394-8fbe-7176f9914471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.459593 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71b3c-b046-4394-8fbe-7176f9914471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.461864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71b3c-b046-4394-8fbe-7176f9914471 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.475975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 957/1911] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:51.480387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf4632-6aa4-4307-a05a-8b234914deff admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.491132 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf4632-6aa4-4307-a05a-8b234914deff admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:51.499077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d229e6b-ba74-401a-aaff-874b5319ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:51.500068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d229e6b-ba74-401a-aaff-874b5319ce1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.500353 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d229e6b-ba74-401a-aaff-874b5319ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.500631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d229e6b-ba74-401a-aaff-874b5319ce1e admin admin] PATH_INFO: `/v3/projects/3deac0acbc804cadb4c0f137d3485b9e/users/53f533c4c70e4302915c1b3b70e9c027/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.517663 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d229e6b-ba74-401a-aaff-874b5319ce1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3deac0acbc804cadb4c0f137d3485b9e, user_id=53f533c4c70e4302915c1b3b70e9c027, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.520787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d229e6b-ba74-401a-aaff-874b5319ce1e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.549829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 955/1912] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:51 2022] PUT /identity/v3/projects/3deac0acbc804cadb4c0f137d3485b9e/users/53f533c4c70e4302915c1b3b70e9c027/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:51.554113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15987a72-eaf1-4db2-8afd-fd79379eeb82 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.556515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15987a72-eaf1-4db2-8afd-fd79379eeb82 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.556515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15987a72-eaf1-4db2-8afd-fd79379eeb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.606810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-15987a72-eaf1-4db2-8afd-fd79379eeb82 None None] MFA Rules not processed for user `53f533c4c70e4302915c1b3b70e9c027`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:51.607808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-15987a72-eaf1-4db2-8afd-fd79379eeb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:51.725987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 958/1913] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:51.741532 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d229e6b-ba74-401a-aaff-874b5319ce1e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.741692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15987a72-eaf1-4db2-8afd-fd79379eeb82 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.743379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5d229e6b-ba74-401a-aaff-874b5319ce1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:51.744106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-15987a72-eaf1-4db2-8afd-fd79379eeb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:51.799852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:51.835206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15987a72-eaf1-4db2-8afd-fd79379eeb82 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:51.840252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf967ed-d069-4001-8446-3c53d445b17f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:51.841424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf967ed-d069-4001-8446-3c53d445b17f service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.841424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf967ed-d069-4001-8446-3c53d445b17f service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.841710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf967ed-d069-4001-8446-3c53d445b17f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.851851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf967ed-d069-4001-8446-3c53d445b17f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.853867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf967ed-d069-4001-8446-3c53d445b17f service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.857547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d229e6b-ba74-401a-aaff-874b5319ce1e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:51.862656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:51.863443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.863935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.864284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] PATH_INFO: `/v3/projects/7ca7d1cb31ba46eaa9fe661a8bbbd9c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.864841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 959/1914] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:51.866562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca7d1cb31ba46eaa9fe661a8bbbd9c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.868684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.891903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf967ed-d069-4001-8446-3c53d445b17f service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.904445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf967ed-d069-4001-8446-3c53d445b17f service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:51.910813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:51.911578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:51.912230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:51.912545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] PATH_INFO: `/v3/users/53f533c4c70e4302915c1b3b70e9c027` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:51.913907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f533c4c70e4302915c1b3b70e9c027)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:51.916026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:51.933613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca7d1cb31ba46eaa9fe661a8bbbd9c0', 'request_id': 'req-0b89d80a-9565-4690-b9e6-9ed70743aecf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:51.943989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca7d1cb31ba46eaa9fe661a8bbbd9c0', 'request_id': 'req-0b89d80a-9565-4690-b9e6-9ed70743aecf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:51.962518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca7d1cb31ba46eaa9fe661a8bbbd9c0', 'request_id': 'req-0b89d80a-9565-4690-b9e6-9ed70743aecf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:51.972941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f533c4c70e4302915c1b3b70e9c027'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:51.973666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f533c4c70e4302915c1b3b70e9c027'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:51.974277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f533c4c70e4302915c1b3b70e9c027'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:51.975520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] The token cache is being invalidate because project 7ca7d1cb31ba46eaa9fe661a8bbbd9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:51.975875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:51.976574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:51.978473 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 956/1915] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:51 2022] DELETE /identity/v3/projects/7ca7d1cb31ba46eaa9fe661a8bbbd9c0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:51.982120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:51.983823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:51.986611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f533c4c70e4302915c1b3b70e9c027'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:51.994794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:51.995207 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a066c987-57df-4e97-987f-9015efd62396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f533c4c70e4302915c1b3b70e9c027'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:52.011604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 960/1916] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:51 2022] DELETE /identity/v3/users/53f533c4c70e4302915c1b3b70e9c027 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:52.016905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4374-60f9-4d0e-8170-d4e5e6c8d948 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:52.017438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4374-60f9-4d0e-8170-d4e5e6c8d948 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:52.017709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4374-60f9-4d0e-8170-d4e5e6c8d948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:52.037654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5eac4374-60f9-4d0e-8170-d4e5e6c8d948 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:52.038892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5eac4374-60f9-4d0e-8170-d4e5e6c8d948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:52.061418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d80a-9565-4690-b9e6-9ed70743aecf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:52.109080 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 961/1917] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:52.117909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac4374-60f9-4d0e-8170-d4e5e6c8d948 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:52.119502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5eac4374-60f9-4d0e-8170-d4e5e6c8d948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:52.134618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:52.135469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:52.135960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:52.136286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] PATH_INFO: `/v3/users/f891b43619764a34a34901d22f7d1118` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:52.137824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f891b43619764a34a34901d22f7d1118)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:52.139997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:52.178738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:52.194840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac4374-60f9-4d0e-8170-d4e5e6c8d948 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:52.199168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e6a1-74b7-4892-8822-1064492640b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:52.200086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e6a1-74b7-4892-8822-1064492640b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:52.200282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e6a1-74b7-4892-8822-1064492640b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:52.200806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e6a1-74b7-4892-8822-1064492640b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:52.207250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f891b43619764a34a34901d22f7d1118'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:52.214495 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e6a1-74b7-4892-8822-1064492640b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:52.216646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e6a1-74b7-4892-8822-1064492640b9 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:52.221593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f891b43619764a34a34901d22f7d1118'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:52.231484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 962/1918] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:52.239678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f891b43619764a34a34901d22f7d1118'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:52.247956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f891b43619764a34a34901d22f7d1118'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:52.248669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f891b43619764a34a34901d22f7d1118'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:52.255441 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 957/1919] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:51 2022] DELETE /identity/v3/users/f891b43619764a34a34901d22f7d1118 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:28:52.888330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e6a1-74b7-4892-8822-1064492640b9 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:52.889895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3296e6a1-74b7-4892-8822-1064492640b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:52.913734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e6a1-74b7-4892-8822-1064492640b9 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:52.976577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:52.977241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:52.977546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:52.977821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] PATH_INFO: `/v3/projects/3deac0acbc804cadb4c0f137d3485b9e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:52.979007 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3deac0acbc804cadb4c0f137d3485b9e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:52.980929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:53.067237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3deac0acbc804cadb4c0f137d3485b9e', 'request_id': 'req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.082942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3deac0acbc804cadb4c0f137d3485b9e', 'request_id': 'req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.096283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3deac0acbc804cadb4c0f137d3485b9e', 'request_id': 'req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.111361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] The token cache is being invalidate because project 3deac0acbc804cadb4c0f137d3485b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:53.111650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.112691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2b0e0c4b-dcf1-46b8-9318-7bdb68a050f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.114711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 963/1920] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:52 2022] DELETE /identity/v3/projects/3deac0acbc804cadb4c0f137d3485b9e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:53.261252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:53.264560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:53.283052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd2fd8-855a-4913-a9c1-b0ebd03599fc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:53.338323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:53.370017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:53.370723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.371010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.371289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] PATH_INFO: `/v3/projects/db2b40ce1f6f4a75bd3f89692c0fce83` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:53.372480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2b40ce1f6f4a75bd3f89692c0fce83)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:53.374574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:53.425283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2b40ce1f6f4a75bd3f89692c0fce83', 'request_id': 'req-13c3e34d-79fa-480b-b23b-96529608713d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.434874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2b40ce1f6f4a75bd3f89692c0fce83', 'request_id': 'req-13c3e34d-79fa-480b-b23b-96529608713d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.441433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2b40ce1f6f4a75bd3f89692c0fce83', 'request_id': 'req-13c3e34d-79fa-480b-b23b-96529608713d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.454083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] The token cache is being invalidate because project db2b40ce1f6f4a75bd3f89692c0fce83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:53.454347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.455029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13c3e34d-79fa-480b-b23b-96529608713d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:53.456795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 958/1921] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:53 2022] DELETE /identity/v3/projects/db2b40ce1f6f4a75bd3f89692c0fce83 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:53.462530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162930de-49ab-48d1-99d7-0a550b266d78 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.462796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162930de-49ab-48d1-99d7-0a550b266d78 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.463080 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162930de-49ab-48d1-99d7-0a550b266d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:53.484942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-162930de-49ab-48d1-99d7-0a550b266d78 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:53.486241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-162930de-49ab-48d1-99d7-0a550b266d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:53.551914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 964/1922] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:53.559787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5cc5c-c062-4a92-9a50-8b1899082d9a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.560070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5cc5c-c062-4a92-9a50-8b1899082d9a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.560489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5cc5c-c062-4a92-9a50-8b1899082d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:53.583153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-16d5cc5c-c062-4a92-9a50-8b1899082d9a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:53.584468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-16d5cc5c-c062-4a92-9a50-8b1899082d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:53.593516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 959/1923] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:53.598124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162930de-49ab-48d1-99d7-0a550b266d78 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:53.609109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162930de-49ab-48d1-99d7-0a550b266d78 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:53.615209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a750bd2-9555-4471-b2b8-6a6fa3ebfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:53.616174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a750bd2-9555-4471-b2b8-6a6fa3ebfa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.616455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a750bd2-9555-4471-b2b8-6a6fa3ebfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.616722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a750bd2-9555-4471-b2b8-6a6fa3ebfa36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:53.617469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a750bd2-9555-4471-b2b8-6a6fa3ebfa36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:28:53.617771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a750bd2-9555-4471-b2b8-6a6fa3ebfa36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:53.619453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a750bd2-9555-4471-b2b8-6a6fa3ebfa36 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:53.639683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 965/1924] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:28:53.644280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5cc5c-c062-4a92-9a50-8b1899082d9a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:53.654095 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5cc5c-c062-4a92-9a50-8b1899082d9a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:53.658733 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549b275-7b1e-4303-876f-8a9445e9c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:53.659390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549b275-7b1e-4303-876f-8a9445e9c515 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.659654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549b275-7b1e-4303-876f-8a9445e9c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.659921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549b275-7b1e-4303-876f-8a9445e9c515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:53.660617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549b275-7b1e-4303-876f-8a9445e9c515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:53.662563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549b275-7b1e-4303-876f-8a9445e9c515 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:53.707591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 960/1925] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:53 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:53.711985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a750bd2-9555-4471-b2b8-6a6fa3ebfa36 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:53.718063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:53.726075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a750bd2-9555-4471-b2b8-6a6fa3ebfa36 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:53.796263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc2fc-a085-474c-8537-5d6af115d36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:53.796911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc2fc-a085-474c-8537-5d6af115d36d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.797349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc2fc-a085-474c-8537-5d6af115d36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.797624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc2fc-a085-474c-8537-5d6af115d36d admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:53.798357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bc2fc-a085-474c-8537-5d6af115d36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:53.800640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bc2fc-a085-474c-8537-5d6af115d36d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:53.825455 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 966/1926] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:53 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:53.830142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549b275-7b1e-4303-876f-8a9445e9c515 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:53.842098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549b275-7b1e-4303-876f-8a9445e9c515 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:53.848544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0717-3481-48b8-bfa7-e4b671aaeeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:53.849306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0717-3481-48b8-bfa7-e4b671aaeeca admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.849654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0717-3481-48b8-bfa7-e4b671aaeeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.850749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0717-3481-48b8-bfa7-e4b671aaeeca admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:53.850749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d0717-3481-48b8-bfa7-e4b671aaeeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:53.852449 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d0717-3481-48b8-bfa7-e4b671aaeeca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:53.865995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 961/1927] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:53.870062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc2fc-a085-474c-8537-5d6af115d36d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:53.880708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc2fc-a085-474c-8537-5d6af115d36d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:53.885927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414faad-bdf2-4efb-b5a9-65eb5afcc9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:53.887038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414faad-bdf2-4efb-b5a9-65eb5afcc9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.887038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414faad-bdf2-4efb-b5a9-65eb5afcc9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.887394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414faad-bdf2-4efb-b5a9-65eb5afcc9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:53.887969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414faad-bdf2-4efb-b5a9-65eb5afcc9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:53.889867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414faad-bdf2-4efb-b5a9-65eb5afcc9e6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:53.902929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 967/1928] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:28:53.907790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0717-3481-48b8-bfa7-e4b671aaeeca admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:53.919033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0717-3481-48b8-bfa7-e4b671aaeeca admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:53.933114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78a3b3-5d50-4b87-8ab5-e62cb4e6b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:53.933888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78a3b3-5d50-4b87-8ab5-e62cb4e6b1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.934266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78a3b3-5d50-4b87-8ab5-e62cb4e6b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.934560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78a3b3-5d50-4b87-8ab5-e62cb4e6b1a1 admin admin] PATH_INFO: `/v3/projects/c884f431b389404280c4ab846932d8ec/users/d41eba6e825d46ce90c92d1af515b661/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:53.951811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78a3b3-5d50-4b87-8ab5-e62cb4e6b1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c884f431b389404280c4ab846932d8ec, user_id=d41eba6e825d46ce90c92d1af515b661, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:53.954929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78a3b3-5d50-4b87-8ab5-e62cb4e6b1a1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:53.977999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 962/1929] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:53 2022] PUT /identity/v3/projects/c884f431b389404280c4ab846932d8ec/users/d41eba6e825d46ce90c92d1af515b661/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:53.983498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1ad6-71e4-41ef-a233-c5dff5a9698f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:53.984330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1ad6-71e4-41ef-a233-c5dff5a9698f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:53.984330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1ad6-71e4-41ef-a233-c5dff5a9698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:54.015869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9f7b1ad6-71e4-41ef-a233-c5dff5a9698f None None] MFA Rules not processed for user `d41eba6e825d46ce90c92d1af515b661`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:54.017130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f7b1ad6-71e4-41ef-a233-c5dff5a9698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:54.096726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 968/1930] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:28:54.101444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78a3b3-5d50-4b87-8ab5-e62cb4e6b1a1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:54.205898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78a3b3-5d50-4b87-8ab5-e62cb4e6b1a1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:54.212615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350674bf-2f71-41a2-8659-c448c4747d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:54.213676 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350674bf-2f71-41a2-8659-c448c4747d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:54.214145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350674bf-2f71-41a2-8659-c448c4747d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:54.214564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350674bf-2f71-41a2-8659-c448c4747d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:54.215417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350674bf-2f71-41a2-8659-c448c4747d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:54.217840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350674bf-2f71-41a2-8659-c448c4747d48 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:54.224551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:54.263873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 963/1931] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:28:54 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:54.268573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1ad6-71e4-41ef-a233-c5dff5a9698f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:54.280950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1ad6-71e4-41ef-a233-c5dff5a9698f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:54.386752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272a03d-cb2a-4fb8-b278-0f11b7c5b2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:54.387359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272a03d-cb2a-4fb8-b278-0f11b7c5b2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:54.387636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272a03d-cb2a-4fb8-b278-0f11b7c5b2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:54.387996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272a03d-cb2a-4fb8-b278-0f11b7c5b2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:54.388866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272a03d-cb2a-4fb8-b278-0f11b7c5b2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:54.392082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272a03d-cb2a-4fb8-b278-0f11b7c5b2f1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:54.421743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:54.432509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 969/1932] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:28:54 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:28:54.433454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350674bf-2f71-41a2-8659-c448c4747d48 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:54.447850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350674bf-2f71-41a2-8659-c448c4747d48 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:54.453306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dc971-c977-4167-8197-e0d839eed840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:54.455688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc971-c977-4167-8197-e0d839eed840 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:54.455688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc971-c977-4167-8197-e0d839eed840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:54.455930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc971-c977-4167-8197-e0d839eed840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:54.456626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dc971-c977-4167-8197-e0d839eed840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:54.459527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dc971-c977-4167-8197-e0d839eed840 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:54.474458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 964/1933] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:54.478642 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272a03d-cb2a-4fb8-b278-0f11b7c5b2f1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:54.490025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272a03d-cb2a-4fb8-b278-0f11b7c5b2f1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:54.503217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfc952-d89d-4e92-9c16-28f4216937a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:54.504581 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfc952-d89d-4e92-9c16-28f4216937a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:54.505070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfc952-d89d-4e92-9c16-28f4216937a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:54.505586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfc952-d89d-4e92-9c16-28f4216937a8 admin admin] PATH_INFO: `/v3/projects/c1114acc740841b982cc3f9329aa75fe/users/636d7688efb44be6afbb2bf6ff29627d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:54.527989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfc952-d89d-4e92-9c16-28f4216937a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1114acc740841b982cc3f9329aa75fe, user_id=636d7688efb44be6afbb2bf6ff29627d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:54.545736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfc952-d89d-4e92-9c16-28f4216937a8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:54.572375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 970/1934] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:54 2022] PUT /identity/v3/projects/c1114acc740841b982cc3f9329aa75fe/users/636d7688efb44be6afbb2bf6ff29627d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:54.578263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dc971-c977-4167-8197-e0d839eed840 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:54.592455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dc971-c977-4167-8197-e0d839eed840 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:54.713547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d03ab2-2b9e-4568-95e3-850e42acf3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:54.714886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03ab2-2b9e-4568-95e3-850e42acf3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:54.716743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03ab2-2b9e-4568-95e3-850e42acf3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:54.717050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03ab2-2b9e-4568-95e3-850e42acf3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:54.717851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d03ab2-2b9e-4568-95e3-850e42acf3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:54.719583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d03ab2-2b9e-4568-95e3-850e42acf3a0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:54.737491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 965/1935] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:28:54.740573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfc952-d89d-4e92-9c16-28f4216937a8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:54.755413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfc952-d89d-4e92-9c16-28f4216937a8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:54.762708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b6d08-c2c3-4ac8-9d97-deae33c4b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:54.763566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b6d08-c2c3-4ac8-9d97-deae33c4b0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:54.763939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b6d08-c2c3-4ac8-9d97-deae33c4b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:54.764309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b6d08-c2c3-4ac8-9d97-deae33c4b0b4 admin admin] PATH_INFO: `/v3/projects/c1114acc740841b982cc3f9329aa75fe/users/636d7688efb44be6afbb2bf6ff29627d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:54.767084 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b6d08-c2c3-4ac8-9d97-deae33c4b0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1114acc740841b982cc3f9329aa75fe, user_id=636d7688efb44be6afbb2bf6ff29627d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:54.770476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b6d08-c2c3-4ac8-9d97-deae33c4b0b4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:54.783764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 971/1936] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:28:54 2022] PUT /identity/v3/projects/c1114acc740841b982cc3f9329aa75fe/users/636d7688efb44be6afbb2bf6ff29627d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:28:54.794808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c4a37-1d1f-4f9a-89a5-1877e79628ca None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:54.795477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c4a37-1d1f-4f9a-89a5-1877e79628ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:54.795918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c4a37-1d1f-4f9a-89a5-1877e79628ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:54.834796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-983c4a37-1d1f-4f9a-89a5-1877e79628ca None None] MFA Rules not processed for user `636d7688efb44be6afbb2bf6ff29627d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:54.836052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-983c4a37-1d1f-4f9a-89a5-1877e79628ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:54.986270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 966/1937] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:54.998146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b6d08-c2c3-4ac8-9d97-deae33c4b0b4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:55.000869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-739b6d08-c2c3-4ac8-9d97-deae33c4b0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:55.093665 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b6d08-c2c3-4ac8-9d97-deae33c4b0b4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:55.099714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df749c-c55d-45bf-bf5a-dd558c5b1702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:55.100533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df749c-c55d-45bf-bf5a-dd558c5b1702 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:55.101028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df749c-c55d-45bf-bf5a-dd558c5b1702 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:55.101438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df749c-c55d-45bf-bf5a-dd558c5b1702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:55.115425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df749c-c55d-45bf-bf5a-dd558c5b1702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:55.117362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df749c-c55d-45bf-bf5a-dd558c5b1702 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:55.132652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 972/1938] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:55.256235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c4a37-1d1f-4f9a-89a5-1877e79628ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:55.267088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c4a37-1d1f-4f9a-89a5-1877e79628ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:55.277762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef152c-83e7-4a70-812c-3ea5523ea89a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:55.280914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef152c-83e7-4a70-812c-3ea5523ea89a service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:55.281539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef152c-83e7-4a70-812c-3ea5523ea89a service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:55.282040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef152c-83e7-4a70-812c-3ea5523ea89a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:55.411261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:55.422193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef152c-83e7-4a70-812c-3ea5523ea89a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:55.424065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef152c-83e7-4a70-812c-3ea5523ea89a service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:55.436331 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 967/1939] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:28:58.362680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df749c-c55d-45bf-bf5a-dd558c5b1702 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:58.455942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df749c-c55d-45bf-bf5a-dd558c5b1702 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:58.461139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:58.462756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:58.463038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:58.463309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] PATH_INFO: `/v3/users/d41eba6e825d46ce90c92d1af515b661` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:58.464947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41eba6e825d46ce90c92d1af515b661)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:58.467473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:58.534460 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41eba6e825d46ce90c92d1af515b661'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:58.535514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41eba6e825d46ce90c92d1af515b661'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:58.536827 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41eba6e825d46ce90c92d1af515b661'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:58.555243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41eba6e825d46ce90c92d1af515b661'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:58.559917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:58.566892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41eba6e825d46ce90c92d1af515b661'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:58.586539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 973/1940] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:58 2022] DELETE /identity/v3/users/d41eba6e825d46ce90c92d1af515b661 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:28:58.591161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ee560-7b59-4aa7-bca6-c340555923a4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:58.591786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ee560-7b59-4aa7-bca6-c340555923a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:58.591786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ee560-7b59-4aa7-bca6-c340555923a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:58.615164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f36ee560-7b59-4aa7-bca6-c340555923a4 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:58.616404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f36ee560-7b59-4aa7-bca6-c340555923a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:58.688417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 968/1941] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:28:58.707347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:58.708836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:58.769387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed02e75-701e-4360-941c-e63b1b5959df admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:58.774067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f340ec7-f987-49cc-8dcd-6aa3f2bfb574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:58.774728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340ec7-f987-49cc-8dcd-6aa3f2bfb574 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:58.775004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340ec7-f987-49cc-8dcd-6aa3f2bfb574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:58.775283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340ec7-f987-49cc-8dcd-6aa3f2bfb574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:58.786266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f340ec7-f987-49cc-8dcd-6aa3f2bfb574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:58.788218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f340ec7-f987-49cc-8dcd-6aa3f2bfb574 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:58.799545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 974/1942] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:28:59.095890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ee560-7b59-4aa7-bca6-c340555923a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:59.097536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f36ee560-7b59-4aa7-bca6-c340555923a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:59.110289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ee560-7b59-4aa7-bca6-c340555923a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:59.116291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:59.116459 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:59.116728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:59.117003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] PATH_INFO: `/v3/projects/c884f431b389404280c4ab846932d8ec` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:59.118259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c884f431b389404280c4ab846932d8ec)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:59.120246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:59.181697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c884f431b389404280c4ab846932d8ec', 'request_id': 'req-8017ed60-e570-4b6d-afd1-a89631fc705c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.192479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c884f431b389404280c4ab846932d8ec', 'request_id': 'req-8017ed60-e570-4b6d-afd1-a89631fc705c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.202853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c884f431b389404280c4ab846932d8ec', 'request_id': 'req-8017ed60-e570-4b6d-afd1-a89631fc705c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.221464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] The token cache is being invalidate because project c884f431b389404280c4ab846932d8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:59.221925 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.222806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.227511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 969/1943] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:59 2022] DELETE /identity/v3/projects/c884f431b389404280c4ab846932d8ec => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:59.228738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f340ec7-f987-49cc-8dcd-6aa3f2bfb574 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:59.242234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f340ec7-f987-49cc-8dcd-6aa3f2bfb574 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:59.316534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:59.317431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:59.317710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:59.317983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] PATH_INFO: `/v3/users/636d7688efb44be6afbb2bf6ff29627d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:59.319479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] RBAC: Authorizing `identity:delete_user(user_id=636d7688efb44be6afbb2bf6ff29627d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:59.321243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:59.375602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636d7688efb44be6afbb2bf6ff29627d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.376713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636d7688efb44be6afbb2bf6ff29627d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.377392 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636d7688efb44be6afbb2bf6ff29627d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.393867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636d7688efb44be6afbb2bf6ff29627d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.403694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7a67adbe-11cf-4efb-99b5-30b87e2fc67d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636d7688efb44be6afbb2bf6ff29627d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.418940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 975/1944] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:28:59 2022] DELETE /identity/v3/users/636d7688efb44be6afbb2bf6ff29627d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:59.727667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:28:59.729453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:28:59.744087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017ed60-e570-4b6d-afd1-a89631fc705c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:28:59.806229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:28:59.806892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:59.807173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:59.807448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] PATH_INFO: `/v3/projects/c1114acc740841b982cc3f9329aa75fe` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:59.808620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1114acc740841b982cc3f9329aa75fe)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:28:59.810650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:28:59.832320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:59.880476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1114acc740841b982cc3f9329aa75fe', 'request_id': 'req-95b7f0b5-078a-4f76-a374-886f2152b576'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.889662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1114acc740841b982cc3f9329aa75fe', 'request_id': 'req-95b7f0b5-078a-4f76-a374-886f2152b576'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.896696 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1114acc740841b982cc3f9329aa75fe', 'request_id': 'req-95b7f0b5-078a-4f76-a374-886f2152b576'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.917197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] The token cache is being invalidate because project c1114acc740841b982cc3f9329aa75fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:28:59.917541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.918241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95b7f0b5-078a-4f76-a374-886f2152b576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:28:59.920749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 970/1945] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:28:59 2022] DELETE /identity/v3/projects/c1114acc740841b982cc3f9329aa75fe => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:28:59.925739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b5c51-4857-44b2-885e-fbf6ce4045d7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:28:59.926030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b5c51-4857-44b2-885e-fbf6ce4045d7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:28:59.926307 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b5c51-4857-44b2-885e-fbf6ce4045d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:28:59.943638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:28:59.952907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d58b5c51-4857-44b2-885e-fbf6ce4045d7 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:28:59.955042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d58b5c51-4857-44b2-885e-fbf6ce4045d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:00.024498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 976/1946] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:00.032422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ff7f-f477-4b8a-8655-63a27cc47175 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.032701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ff7f-f477-4b8a-8655-63a27cc47175 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.032975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ff7f-f477-4b8a-8655-63a27cc47175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.053042 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-11d8ff7f-f477-4b8a-8655-63a27cc47175 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:00.054313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-11d8ff7f-f477-4b8a-8655-63a27cc47175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:00.063334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 971/1947] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:00.068688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b5c51-4857-44b2-885e-fbf6ce4045d7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:00.080109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b5c51-4857-44b2-885e-fbf6ce4045d7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:00.085687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d5791-d7cc-4415-aee1-2846f2111def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:00.086337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5791-d7cc-4415-aee1-2846f2111def admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.086731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5791-d7cc-4415-aee1-2846f2111def admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.087050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5791-d7cc-4415-aee1-2846f2111def admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.087712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d5791-d7cc-4415-aee1-2846f2111def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:00.088012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d5791-d7cc-4415-aee1-2846f2111def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:00.089660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d5791-d7cc-4415-aee1-2846f2111def admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:00.102912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 977/1948] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:00.107448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8ff7f-f477-4b8a-8655-63a27cc47175 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:00.118130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8ff7f-f477-4b8a-8655-63a27cc47175 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:00.123181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31f7c-4546-42a9-9df6-d593ae8bc8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:00.123943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31f7c-4546-42a9-9df6-d593ae8bc8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.124290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31f7c-4546-42a9-9df6-d593ae8bc8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.124636 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31f7c-4546-42a9-9df6-d593ae8bc8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.125435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e31f7c-4546-42a9-9df6-d593ae8bc8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:00.127443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e31f7c-4546-42a9-9df6-d593ae8bc8aa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:00.160284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 972/1949] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:00 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:00.161560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d5791-d7cc-4415-aee1-2846f2111def admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:00.172634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d5791-d7cc-4415-aee1-2846f2111def admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:00.247428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74922d7-1cbc-44e3-a438-968c7d405908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:00.248090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74922d7-1cbc-44e3-a438-968c7d405908 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.248568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74922d7-1cbc-44e3-a438-968c7d405908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.249086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74922d7-1cbc-44e3-a438-968c7d405908 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.249977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74922d7-1cbc-44e3-a438-968c7d405908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:00.252324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74922d7-1cbc-44e3-a438-968c7d405908 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:00.279499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 978/1950] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:00 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:00.280940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31f7c-4546-42a9-9df6-d593ae8bc8aa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:00.291511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31f7c-4546-42a9-9df6-d593ae8bc8aa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:00.297882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903154f-37c1-4931-8c4e-612214a8ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:00.298523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903154f-37c1-4931-8c4e-612214a8ebca admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.298822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903154f-37c1-4931-8c4e-612214a8ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.299034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903154f-37c1-4931-8c4e-612214a8ebca admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.299741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903154f-37c1-4931-8c4e-612214a8ebca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:00.301383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903154f-37c1-4931-8c4e-612214a8ebca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:00.312068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 973/1951] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:00.316194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74922d7-1cbc-44e3-a438-968c7d405908 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:00.328991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74922d7-1cbc-44e3-a438-968c7d405908 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:00.334061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcea69-26b0-45d5-8bed-42b2be93b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:00.334704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcea69-26b0-45d5-8bed-42b2be93b62e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.334964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcea69-26b0-45d5-8bed-42b2be93b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.335230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcea69-26b0-45d5-8bed-42b2be93b62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.335940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcea69-26b0-45d5-8bed-42b2be93b62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:00.337573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcea69-26b0-45d5-8bed-42b2be93b62e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:00.352377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 979/1952] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:00.353622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903154f-37c1-4931-8c4e-612214a8ebca admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:00.364231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903154f-37c1-4931-8c4e-612214a8ebca admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:00.369572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9568b51-38be-4277-bd24-01039fa1ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:00.370262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9568b51-38be-4277-bd24-01039fa1ed45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.370545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9568b51-38be-4277-bd24-01039fa1ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.370813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9568b51-38be-4277-bd24-01039fa1ed45 admin admin] PATH_INFO: `/v3/projects/f3ca873be8904e9aa29a3c2c8d94ed87/users/d86d918dc7ed468ab1fd95bc64d9ce38/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.386630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9568b51-38be-4277-bd24-01039fa1ed45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ca873be8904e9aa29a3c2c8d94ed87, user_id=d86d918dc7ed468ab1fd95bc64d9ce38, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:00.389384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9568b51-38be-4277-bd24-01039fa1ed45 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:00.408000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 974/1953] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:00 2022] PUT /identity/v3/projects/f3ca873be8904e9aa29a3c2c8d94ed87/users/d86d918dc7ed468ab1fd95bc64d9ce38/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:00.420652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a434-9380-43cf-a65a-aae0f31784f7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.421196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a434-9380-43cf-a65a-aae0f31784f7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.421314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a434-9380-43cf-a65a-aae0f31784f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.453053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fa18a434-9380-43cf-a65a-aae0f31784f7 None None] MFA Rules not processed for user `d86d918dc7ed468ab1fd95bc64d9ce38`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:00.454394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fa18a434-9380-43cf-a65a-aae0f31784f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:00.529875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 980/1954] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:00.538558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9568b51-38be-4277-bd24-01039fa1ed45 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:00.541863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9568b51-38be-4277-bd24-01039fa1ed45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:00.621032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9568b51-38be-4277-bd24-01039fa1ed45 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:00.624885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f5087-c78c-4345-b85c-04797281beec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:00.625571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f5087-c78c-4345-b85c-04797281beec service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.625853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f5087-c78c-4345-b85c-04797281beec service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.626135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f5087-c78c-4345-b85c-04797281beec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.635855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f5087-c78c-4345-b85c-04797281beec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:00.637405 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f5087-c78c-4345-b85c-04797281beec service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:00.647607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 975/1955] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:00.670442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a434-9380-43cf-a65a-aae0f31784f7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:00.675873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:00.758819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a434-9380-43cf-a65a-aae0f31784f7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:00.764374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:00.765061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.765381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.765660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] PATH_INFO: `/v3/users/d86d918dc7ed468ab1fd95bc64d9ce38` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.767089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86d918dc7ed468ab1fd95bc64d9ce38)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:00.769075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:00.824126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86d918dc7ed468ab1fd95bc64d9ce38'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:00.825043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86d918dc7ed468ab1fd95bc64d9ce38'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:00.825655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86d918dc7ed468ab1fd95bc64d9ce38'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:00.847087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86d918dc7ed468ab1fd95bc64d9ce38'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:00.869287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86d918dc7ed468ab1fd95bc64d9ce38'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:00.880959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 981/1956] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:00 2022] DELETE /identity/v3/users/d86d918dc7ed468ab1fd95bc64d9ce38 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:00.885829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78009c7-dc50-4e1e-abf3-5a6ded648baa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:00.886356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78009c7-dc50-4e1e-abf3-5a6ded648baa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:00.886435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78009c7-dc50-4e1e-abf3-5a6ded648baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:00.910602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b78009c7-dc50-4e1e-abf3-5a6ded648baa None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:00.911894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b78009c7-dc50-4e1e-abf3-5a6ded648baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:00.962772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:00.987083 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 976/1957] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:00.997398 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:00.998898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:01.075287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9941c1-a3d7-41a4-ad97-d5fda29159ad admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:01.080419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa312dc7-f31c-45c2-b0b1-9b190d32f17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:01.081219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa312dc7-f31c-45c2-b0b1-9b190d32f17d service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:01.081658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa312dc7-f31c-45c2-b0b1-9b190d32f17d service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:01.081946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa312dc7-f31c-45c2-b0b1-9b190d32f17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:01.093794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa312dc7-f31c-45c2-b0b1-9b190d32f17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:01.095432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa312dc7-f31c-45c2-b0b1-9b190d32f17d service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:01.107766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 982/1958] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:01.648368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78009c7-dc50-4e1e-abf3-5a6ded648baa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:01.649969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b78009c7-dc50-4e1e-abf3-5a6ded648baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:01.663853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78009c7-dc50-4e1e-abf3-5a6ded648baa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:01.668831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:01.669619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:01.669896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:01.670170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] PATH_INFO: `/v3/projects/f3ca873be8904e9aa29a3c2c8d94ed87` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:01.671393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ca873be8904e9aa29a3c2c8d94ed87)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:01.673496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:01.760255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ca873be8904e9aa29a3c2c8d94ed87', 'request_id': 'req-57c90612-306a-4ea7-b0c3-ec5228c3f103'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:01.773977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ca873be8904e9aa29a3c2c8d94ed87', 'request_id': 'req-57c90612-306a-4ea7-b0c3-ec5228c3f103'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:01.781860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ca873be8904e9aa29a3c2c8d94ed87', 'request_id': 'req-57c90612-306a-4ea7-b0c3-ec5228c3f103'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:01.795034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] The token cache is being invalidate because project f3ca873be8904e9aa29a3c2c8d94ed87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:01.795414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:01.796079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57c90612-306a-4ea7-b0c3-ec5228c3f103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:01.797774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 977/1959] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:01 2022] DELETE /identity/v3/projects/f3ca873be8904e9aa29a3c2c8d94ed87 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:01.802914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c19c5-1e5e-4257-b850-26b56e23a01d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:01.803510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c19c5-1e5e-4257-b850-26b56e23a01d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:01.803721 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c19c5-1e5e-4257-b850-26b56e23a01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:01.834096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9a4c19c5-1e5e-4257-b850-26b56e23a01d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:01.836632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9a4c19c5-1e5e-4257-b850-26b56e23a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:01.880848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:01.955783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 983/1960] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:01.967044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da9f5-497c-4669-865d-95707f9feb9a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:01.967951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da9f5-497c-4669-865d-95707f9feb9a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:01.968410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da9f5-497c-4669-865d-95707f9feb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:02.011037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f98da9f5-497c-4669-865d-95707f9feb9a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:02.013955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f98da9f5-497c-4669-865d-95707f9feb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:02.037715 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c19c5-1e5e-4257-b850-26b56e23a01d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:02.045773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 978/1961] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:02.054043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c19c5-1e5e-4257-b850-26b56e23a01d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:02.060164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffa65d-5d6b-4f9a-97de-20cd96267c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:02.061296 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffa65d-5d6b-4f9a-97de-20cd96267c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:02.061792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffa65d-5d6b-4f9a-97de-20cd96267c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:02.062298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffa65d-5d6b-4f9a-97de-20cd96267c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:02.063284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffa65d-5d6b-4f9a-97de-20cd96267c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:02.063791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffa65d-5d6b-4f9a-97de-20cd96267c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:02.065562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffa65d-5d6b-4f9a-97de-20cd96267c61 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:02.083140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 984/1962] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:02.089628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da9f5-497c-4669-865d-95707f9feb9a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:02.108010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da9f5-497c-4669-865d-95707f9feb9a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:02.124651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1307-9f9a-44bf-8634-df40c65978ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:02.125472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1307-9f9a-44bf-8634-df40c65978ae admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:02.126055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1307-9f9a-44bf-8634-df40c65978ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:02.126334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1307-9f9a-44bf-8634-df40c65978ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:02.127058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1307-9f9a-44bf-8634-df40c65978ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:02.129041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1307-9f9a-44bf-8634-df40c65978ae admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:02.178322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffa65d-5d6b-4f9a-97de-20cd96267c61 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:02.181225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 979/1963] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:02 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:02.198222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffa65d-5d6b-4f9a-97de-20cd96267c61 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:02.280986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88092875-d5ca-4b16-9d76-517b7cfcba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:02.281661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092875-d5ca-4b16-9d76-517b7cfcba20 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:02.281940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092875-d5ca-4b16-9d76-517b7cfcba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:02.282209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092875-d5ca-4b16-9d76-517b7cfcba20 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:02.282900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88092875-d5ca-4b16-9d76-517b7cfcba20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:02.284911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88092875-d5ca-4b16-9d76-517b7cfcba20 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:02.310310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 985/1964] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:02 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:02.315021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1307-9f9a-44bf-8634-df40c65978ae admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:02.327990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1307-9f9a-44bf-8634-df40c65978ae admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:02.336997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e51a1-aba3-4ba4-b798-929f67838706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:02.337773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e51a1-aba3-4ba4-b798-929f67838706 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:02.338574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e51a1-aba3-4ba4-b798-929f67838706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:02.338865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e51a1-aba3-4ba4-b798-929f67838706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:02.339625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e51a1-aba3-4ba4-b798-929f67838706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:02.341883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e51a1-aba3-4ba4-b798-929f67838706 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:02.358980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 980/1965] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:02.363089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88092875-d5ca-4b16-9d76-517b7cfcba20 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:02.374659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88092875-d5ca-4b16-9d76-517b7cfcba20 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:02.386608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cc58b-5ba5-4965-a13f-194935f35553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:02.389618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc58b-5ba5-4965-a13f-194935f35553 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:02.389851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc58b-5ba5-4965-a13f-194935f35553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:02.390127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc58b-5ba5-4965-a13f-194935f35553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:02.390864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cc58b-5ba5-4965-a13f-194935f35553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:02.392609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cc58b-5ba5-4965-a13f-194935f35553 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:02.407364 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 986/1966] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:02.411735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e51a1-aba3-4ba4-b798-929f67838706 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:02.423166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e51a1-aba3-4ba4-b798-929f67838706 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:02.429600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419fda-3682-431e-a956-64d55085891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:02.430437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419fda-3682-431e-a956-64d55085891f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:02.430744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419fda-3682-431e-a956-64d55085891f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:02.431014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419fda-3682-431e-a956-64d55085891f admin admin] PATH_INFO: `/v3/projects/698657a0c8fc4b8ca28b821ce7985f06/users/67d358579a714c5898cf310c11286ed5/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:02.460910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48419fda-3682-431e-a956-64d55085891f admin admin] RBAC: Authorizing `identity:create_grant(project_id=698657a0c8fc4b8ca28b821ce7985f06, user_id=67d358579a714c5898cf310c11286ed5, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:02.464256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48419fda-3682-431e-a956-64d55085891f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:02.492633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 981/1967] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:02 2022] PUT /identity/v3/projects/698657a0c8fc4b8ca28b821ce7985f06/users/67d358579a714c5898cf310c11286ed5/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:02.494284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7ab90-274f-4d47-a75e-b80650316d4a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:02.494972 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7ab90-274f-4d47-a75e-b80650316d4a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:02.495731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7ab90-274f-4d47-a75e-b80650316d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:02.564438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cca7ab90-274f-4d47-a75e-b80650316d4a None None] MFA Rules not processed for user `67d358579a714c5898cf310c11286ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:02.567074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cca7ab90-274f-4d47-a75e-b80650316d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:02.717365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 987/1968] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:02.732047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419fda-3682-431e-a956-64d55085891f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:02.735899 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-48419fda-3682-431e-a956-64d55085891f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:02.901661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419fda-3682-431e-a956-64d55085891f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:02.901661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0de890-3f63-45a0-9491-82aac0e16019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:02.901661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de890-3f63-45a0-9491-82aac0e16019 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:02.901661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de890-3f63-45a0-9491-82aac0e16019 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:02.901948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de890-3f63-45a0-9491-82aac0e16019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:02.912239 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0de890-3f63-45a0-9491-82aac0e16019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:02.914162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0de890-3f63-45a0-9491-82aac0e16019 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:02.930789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 982/1969] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:03.681080 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603168-0754-4084-9d9b-e9d64eebba32 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:03.681676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603168-0754-4084-9d9b-e9d64eebba32 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:03.681676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603168-0754-4084-9d9b-e9d64eebba32 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:03.683239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 988/1970] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:29:03.709717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f8abe-3528-4bd9-8537-3111d4ba46fc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:03.710252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f8abe-3528-4bd9-8537-3111d4ba46fc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:03.710252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f8abe-3528-4bd9-8537-3111d4ba46fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:03.733806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1d3f8abe-3528-4bd9-8537-3111d4ba46fc None None] MFA Rules not processed for user `826fd481bf2e40d6917bb604591a75cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:03.735172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1d3f8abe-3528-4bd9-8537-3111d4ba46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:03.742690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:03.752320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603168-0754-4084-9d9b-e9d64eebba32 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:03.754722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b3603168-0754-4084-9d9b-e9d64eebba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:03.784203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:03.827793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 983/1971] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:29:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:03.839883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f8abe-3528-4bd9-8537-3111d4ba46fc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:03.840051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603168-0754-4084-9d9b-e9d64eebba32 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:03.841380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1d3f8abe-3528-4bd9-8537-3111d4ba46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:03.844885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:03.845647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:03.845932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:03.846221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] PATH_INFO: `/v3/users/31bea709ad2f46889801dbba09976e43` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:03.847421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bea709ad2f46889801dbba09976e43)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:03.849470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:03.857240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f8abe-3528-4bd9-8537-3111d4ba46fc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:03.863922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed62d8f-075a-4ebd-8403-d46b4689b916 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:03.865506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed62d8f-075a-4ebd-8403-d46b4689b916 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:03.866037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed62d8f-075a-4ebd-8403-d46b4689b916 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:03.866521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed62d8f-075a-4ebd-8403-d46b4689b916 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:03.884435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed62d8f-075a-4ebd-8403-d46b4689b916 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:03.888623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed62d8f-075a-4ebd-8403-d46b4689b916 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:03.909011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 984/1972] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:29:03.939637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bea709ad2f46889801dbba09976e43'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:03.940372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bea709ad2f46889801dbba09976e43'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:03.941241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bea709ad2f46889801dbba09976e43'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:03.965345 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bea709ad2f46889801dbba09976e43'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:03.981119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-60fb92c3-2799-4ae0-9ad6-ece6bce28e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bea709ad2f46889801dbba09976e43'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:04.007253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 989/1973] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:03 2022] DELETE /identity/v3/users/31bea709ad2f46889801dbba09976e43 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:04.250114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed62d8f-075a-4ebd-8403-d46b4689b916 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:04.262179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed62d8f-075a-4ebd-8403-d46b4689b916 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:04.338054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:04.341321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.341321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.341321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] PATH_INFO: `/v3/projects/d2faa29c42654fe69a8c5e12d96b7b4a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:04.341321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2faa29c42654fe69a8c5e12d96b7b4a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:04.343306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:04.400326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2faa29c42654fe69a8c5e12d96b7b4a', 'request_id': 'req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:04.411766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2faa29c42654fe69a8c5e12d96b7b4a', 'request_id': 'req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:04.430116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2faa29c42654fe69a8c5e12d96b7b4a', 'request_id': 'req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:04.445241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] The token cache is being invalidate because project d2faa29c42654fe69a8c5e12d96b7b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:04.445580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:04.446258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8d0c02b6-8386-4c25-9e6c-1a4043f527b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:04.447959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 985/1974] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:04 2022] DELETE /identity/v3/projects/d2faa29c42654fe69a8c5e12d96b7b4a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:04.455254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e6756-3cc9-4946-844f-f0ed15dbc917 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.455830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e6756-3cc9-4946-844f-f0ed15dbc917 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.456325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e6756-3cc9-4946-844f-f0ed15dbc917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:04.486608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b02e6756-3cc9-4946-844f-f0ed15dbc917 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:04.488690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b02e6756-3cc9-4946-844f-f0ed15dbc917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:04.561102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 990/1975] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:04.570101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be1ade-d13c-44b8-8b3b-492bfe31640f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.570285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be1ade-d13c-44b8-8b3b-492bfe31640f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.570523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be1ade-d13c-44b8-8b3b-492bfe31640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:04.592985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-58be1ade-d13c-44b8-8b3b-492bfe31640f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:04.594281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-58be1ade-d13c-44b8-8b3b-492bfe31640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:04.609248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 986/1976] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:04.613816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e6756-3cc9-4946-844f-f0ed15dbc917 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:04.626818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e6756-3cc9-4946-844f-f0ed15dbc917 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:04.641347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8722670-ee31-4de4-b7ea-124b195c7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:04.642217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8722670-ee31-4de4-b7ea-124b195c7466 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.642681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8722670-ee31-4de4-b7ea-124b195c7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.642897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8722670-ee31-4de4-b7ea-124b195c7466 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:04.643751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8722670-ee31-4de4-b7ea-124b195c7466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:04.644209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8722670-ee31-4de4-b7ea-124b195c7466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:04.647851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8722670-ee31-4de4-b7ea-124b195c7466 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:04.664406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 991/1977] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:04.668668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be1ade-d13c-44b8-8b3b-492bfe31640f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:04.679434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be1ade-d13c-44b8-8b3b-492bfe31640f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:04.684559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a48a-f716-45b5-9e27-a10d908eab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:04.685287 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a48a-f716-45b5-9e27-a10d908eab74 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.685575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a48a-f716-45b5-9e27-a10d908eab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.685844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a48a-f716-45b5-9e27-a10d908eab74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:04.686531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521a48a-f716-45b5-9e27-a10d908eab74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:04.688626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521a48a-f716-45b5-9e27-a10d908eab74 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:04.705423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:04.719959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 987/1978] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:04 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:04.724107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8722670-ee31-4de4-b7ea-124b195c7466 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:04.734820 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8722670-ee31-4de4-b7ea-124b195c7466 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:04.761407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:04.798468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471d78f-55ad-426b-8a2d-a99b2c7f7067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:04.799099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471d78f-55ad-426b-8a2d-a99b2c7f7067 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.799380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471d78f-55ad-426b-8a2d-a99b2c7f7067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.799667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471d78f-55ad-426b-8a2d-a99b2c7f7067 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:04.800340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471d78f-55ad-426b-8a2d-a99b2c7f7067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:04.802305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471d78f-55ad-426b-8a2d-a99b2c7f7067 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:04.830305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 992/1979] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:04 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:04.831844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a48a-f716-45b5-9e27-a10d908eab74 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:04.843829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a48a-f716-45b5-9e27-a10d908eab74 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:04.849191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144de5c1-1821-4d6d-9479-9d71a4d73590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:04.850109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144de5c1-1821-4d6d-9479-9d71a4d73590 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.850369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144de5c1-1821-4d6d-9479-9d71a4d73590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.850642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144de5c1-1821-4d6d-9479-9d71a4d73590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:04.851356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144de5c1-1821-4d6d-9479-9d71a4d73590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:04.852999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144de5c1-1821-4d6d-9479-9d71a4d73590 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:04.864549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 988/1980] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:04.868973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471d78f-55ad-426b-8a2d-a99b2c7f7067 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:04.880819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471d78f-55ad-426b-8a2d-a99b2c7f7067 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:04.886289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ba1ce-5b5e-4bde-8a4d-b4fc553a39de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:04.886956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ba1ce-5b5e-4bde-8a4d-b4fc553a39de admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.887243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ba1ce-5b5e-4bde-8a4d-b4fc553a39de admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.887520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ba1ce-5b5e-4bde-8a4d-b4fc553a39de admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:04.888350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ba1ce-5b5e-4bde-8a4d-b4fc553a39de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:04.890492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ba1ce-5b5e-4bde-8a4d-b4fc553a39de admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:04.902946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 993/1981] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:04.907416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144de5c1-1821-4d6d-9479-9d71a4d73590 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:04.918319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144de5c1-1821-4d6d-9479-9d71a4d73590 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:04.923297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b670b-d674-4a2f-a516-fc3b6545cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:04.923989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b670b-d674-4a2f-a516-fc3b6545cc47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.924268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b670b-d674-4a2f-a516-fc3b6545cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.924530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b670b-d674-4a2f-a516-fc3b6545cc47 admin admin] PATH_INFO: `/v3/projects/dddfb07f52db4543acdcd489f9d01199/users/158847ed11c2413199704b0b282b62bf/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:04.940652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b670b-d674-4a2f-a516-fc3b6545cc47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dddfb07f52db4543acdcd489f9d01199, user_id=158847ed11c2413199704b0b282b62bf, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:04.943364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b670b-d674-4a2f-a516-fc3b6545cc47 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:04.961082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 989/1982] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:04 2022] PUT /identity/v3/projects/dddfb07f52db4543acdcd489f9d01199/users/158847ed11c2413199704b0b282b62bf/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:04.971781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d8d86-6c96-49a2-a06d-c658d6dd8ad6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:04.972070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d8d86-6c96-49a2-a06d-c658d6dd8ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:04.972339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d8d86-6c96-49a2-a06d-c658d6dd8ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:05.002882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-aa3d8d86-6c96-49a2-a06d-c658d6dd8ad6 None None] MFA Rules not processed for user `158847ed11c2413199704b0b282b62bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:05.004119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aa3d8d86-6c96-49a2-a06d-c658d6dd8ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:05.075643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 994/1983] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:05.088255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b670b-d674-4a2f-a516-fc3b6545cc47 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:05.090321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c14b670b-d674-4a2f-a516-fc3b6545cc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:05.176615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b670b-d674-4a2f-a516-fc3b6545cc47 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:05.182539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa14f5-db39-4724-8a25-5fca53c535b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:05.183186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa14f5-db39-4724-8a25-5fca53c535b7 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:05.183466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa14f5-db39-4724-8a25-5fca53c535b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:05.183739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa14f5-db39-4724-8a25-5fca53c535b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:05.192510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa14f5-db39-4724-8a25-5fca53c535b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:05.194174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa14f5-db39-4724-8a25-5fca53c535b7 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:05.205832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 990/1984] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:10.385360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d8d86-6c96-49a2-a06d-c658d6dd8ad6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:10.387569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aa3d8d86-6c96-49a2-a06d-c658d6dd8ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:10.462318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d8d86-6c96-49a2-a06d-c658d6dd8ad6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:10.466992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b184cae-e4b0-4bdb-b3d1-80cbfb0b5467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:10.467700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b184cae-e4b0-4bdb-b3d1-80cbfb0b5467 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:10.468019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b184cae-e4b0-4bdb-b3d1-80cbfb0b5467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:10.468334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b184cae-e4b0-4bdb-b3d1-80cbfb0b5467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:10.470732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1b184cae-e4b0-4bdb-b3d1-80cbfb0b5467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:10.531466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:10.550070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b184cae-e4b0-4bdb-b3d1-80cbfb0b5467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:10.551582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b184cae-e4b0-4bdb-b3d1-80cbfb0b5467 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:10.563545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 995/1985] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:11.069686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa14f5-db39-4724-8a25-5fca53c535b7 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:11.155909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa14f5-db39-4724-8a25-5fca53c535b7 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:11.162013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:11.162719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:11.163057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:11.163328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] PATH_INFO: `/v3/users/158847ed11c2413199704b0b282b62bf` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:11.164989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=158847ed11c2413199704b0b282b62bf)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:11.167275 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:11.246135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:11.252957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '158847ed11c2413199704b0b282b62bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:11.269771 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '158847ed11c2413199704b0b282b62bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:11.298776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '158847ed11c2413199704b0b282b62bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:11.313194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '158847ed11c2413199704b0b282b62bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:11.314350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '158847ed11c2413199704b0b282b62bf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:11.329408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 991/1986] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:11 2022] DELETE /identity/v3/users/158847ed11c2413199704b0b282b62bf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:11.334856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129faa1-c6f7-4b4e-bd2a-95818bf7a4fc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:11.336258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129faa1-c6f7-4b4e-bd2a-95818bf7a4fc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:11.336794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129faa1-c6f7-4b4e-bd2a-95818bf7a4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:11.367939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8129faa1-c6f7-4b4e-bd2a-95818bf7a4fc None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:11.369203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8129faa1-c6f7-4b4e-bd2a-95818bf7a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:11.447109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 996/1987] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:11.457863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:11.459317 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:11.538542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e19a-85dd-4586-9849-04572d84d29d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:11.543277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c798-0095-4d03-bda6-3b3702614bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:11.543969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c798-0095-4d03-bda6-3b3702614bbd service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:11.544388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c798-0095-4d03-bda6-3b3702614bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:11.544762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c798-0095-4d03-bda6-3b3702614bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:11.556721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c798-0095-4d03-bda6-3b3702614bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:11.558233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c798-0095-4d03-bda6-3b3702614bbd service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:11.569098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 992/1988] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:12.012882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129faa1-c6f7-4b4e-bd2a-95818bf7a4fc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:12.015319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8129faa1-c6f7-4b4e-bd2a-95818bf7a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:12.033564 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129faa1-c6f7-4b4e-bd2a-95818bf7a4fc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:12.040904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:12.042026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.042704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.043142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] PATH_INFO: `/v3/projects/dddfb07f52db4543acdcd489f9d01199` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.045183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dddfb07f52db4543acdcd489f9d01199)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:12.048852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:12.127893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dddfb07f52db4543acdcd489f9d01199', 'request_id': 'req-78e29868-74e2-4d73-817e-60fbab949385'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:12.139861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dddfb07f52db4543acdcd489f9d01199', 'request_id': 'req-78e29868-74e2-4d73-817e-60fbab949385'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:12.147526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dddfb07f52db4543acdcd489f9d01199', 'request_id': 'req-78e29868-74e2-4d73-817e-60fbab949385'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:12.167844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] The token cache is being invalidate because project dddfb07f52db4543acdcd489f9d01199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:12.168369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:12.169492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e29868-74e2-4d73-817e-60fbab949385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:12.172066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 997/1989] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:12 2022] DELETE /identity/v3/projects/dddfb07f52db4543acdcd489f9d01199 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:12.179222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286704e9-8da4-43de-b983-34db1bd0154f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.179830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286704e9-8da4-43de-b983-34db1bd0154f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.179830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286704e9-8da4-43de-b983-34db1bd0154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.202468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-286704e9-8da4-43de-b983-34db1bd0154f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:12.203784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-286704e9-8da4-43de-b983-34db1bd0154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:12.284470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 993/1990] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:12.293917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021af22-8ca9-4f6c-b84a-5f8ec6914c3a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.294203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021af22-8ca9-4f6c-b84a-5f8ec6914c3a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.294523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021af22-8ca9-4f6c-b84a-5f8ec6914c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.317471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6021af22-8ca9-4f6c-b84a-5f8ec6914c3a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:12.318757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6021af22-8ca9-4f6c-b84a-5f8ec6914c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:12.330332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 998/1991] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:12.337191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286704e9-8da4-43de-b983-34db1bd0154f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:12.353349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286704e9-8da4-43de-b983-34db1bd0154f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:12.361224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439ab99-7115-41f8-bb47-b6f223620670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:12.362495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439ab99-7115-41f8-bb47-b6f223620670 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.362979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439ab99-7115-41f8-bb47-b6f223620670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.363461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439ab99-7115-41f8-bb47-b6f223620670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.364943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439ab99-7115-41f8-bb47-b6f223620670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:12.365473 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439ab99-7115-41f8-bb47-b6f223620670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:12.368668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439ab99-7115-41f8-bb47-b6f223620670 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:12.389516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 994/1992] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:12.398920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021af22-8ca9-4f6c-b84a-5f8ec6914c3a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:12.414115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021af22-8ca9-4f6c-b84a-5f8ec6914c3a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:12.420635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a07d1-8b0b-4eaa-a986-2c656a2f8e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:12.421219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a07d1-8b0b-4eaa-a986-2c656a2f8e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.421562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a07d1-8b0b-4eaa-a986-2c656a2f8e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.421830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a07d1-8b0b-4eaa-a986-2c656a2f8e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.422518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a07d1-8b0b-4eaa-a986-2c656a2f8e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:12.424734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a07d1-8b0b-4eaa-a986-2c656a2f8e0c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:12.472331 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 999/1993] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:12 2022] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:12.473990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439ab99-7115-41f8-bb47-b6f223620670 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:12.503770 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439ab99-7115-41f8-bb47-b6f223620670 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:12.626453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:12.643288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ba52-7eb3-4ab9-beaa-859a7d7de39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:12.644495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ba52-7eb3-4ab9-beaa-859a7d7de39e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.645185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ba52-7eb3-4ab9-beaa-859a7d7de39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.645961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ba52-7eb3-4ab9-beaa-859a7d7de39e admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.647650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ba52-7eb3-4ab9-beaa-859a7d7de39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:12.651886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ba52-7eb3-4ab9-beaa-859a7d7de39e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:12.687085 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 995/1994] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:12 2022] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:12.688310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a07d1-8b0b-4eaa-a986-2c656a2f8e0c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:12.700475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a07d1-8b0b-4eaa-a986-2c656a2f8e0c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:12.706272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817472d-d69a-437d-aa94-dfa466c79b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:12.706942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817472d-d69a-437d-aa94-dfa466c79b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.707220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817472d-d69a-437d-aa94-dfa466c79b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.707501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817472d-d69a-437d-aa94-dfa466c79b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.708236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817472d-d69a-437d-aa94-dfa466c79b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:12.709992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817472d-d69a-437d-aa94-dfa466c79b15 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:12.723002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1000/1995] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:12.727434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ba52-7eb3-4ab9-beaa-859a7d7de39e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:12.738677 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ba52-7eb3-4ab9-beaa-859a7d7de39e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:12.743930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a5410-e718-48f7-9db0-e5b8075964de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:12.744586 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a5410-e718-48f7-9db0-e5b8075964de admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.744866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a5410-e718-48f7-9db0-e5b8075964de admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.745138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a5410-e718-48f7-9db0-e5b8075964de admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.745906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a5410-e718-48f7-9db0-e5b8075964de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:12.747622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a5410-e718-48f7-9db0-e5b8075964de admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:12.760236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 996/1996] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:12.765209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817472d-d69a-437d-aa94-dfa466c79b15 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:12.777117 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817472d-d69a-437d-aa94-dfa466c79b15 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:12.783156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf8d98-f3eb-46f3-b682-3204a03c3d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:12.783927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf8d98-f3eb-46f3-b682-3204a03c3d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.784212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf8d98-f3eb-46f3-b682-3204a03c3d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.784487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf8d98-f3eb-46f3-b682-3204a03c3d3f admin admin] PATH_INFO: `/v3/projects/9db051a5c77544938c0a15a9078db41b/users/8d770fcfd9354ebf8667b3fafe61dac3/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.803232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf8d98-f3eb-46f3-b682-3204a03c3d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db051a5c77544938c0a15a9078db41b, user_id=8d770fcfd9354ebf8667b3fafe61dac3, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:12.806021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf8d98-f3eb-46f3-b682-3204a03c3d3f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:12.823498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1001/1997] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:12 2022] PUT /identity/v3/projects/9db051a5c77544938c0a15a9078db41b/users/8d770fcfd9354ebf8667b3fafe61dac3/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:12.836414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8728a-81c3-4792-8d92-51dca8568130 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:12.836803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8728a-81c3-4792-8d92-51dca8568130 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:12.837092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8728a-81c3-4792-8d92-51dca8568130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:12.871155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3ab8728a-81c3-4792-8d92-51dca8568130 None None] MFA Rules not processed for user `8d770fcfd9354ebf8667b3fafe61dac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:12.872556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ab8728a-81c3-4792-8d92-51dca8568130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:12.976604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 997/1998] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:12.981558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf8d98-f3eb-46f3-b682-3204a03c3d3f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:12.991063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:13.076142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf8d98-f3eb-46f3-b682-3204a03c3d3f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:13.083124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731a631-3776-486e-b6de-bf687af52e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:13.083805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731a631-3776-486e-b6de-bf687af52e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:13.084089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731a631-3776-486e-b6de-bf687af52e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:13.085030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731a631-3776-486e-b6de-bf687af52e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:13.085795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731a631-3776-486e-b6de-bf687af52e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:13.088008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731a631-3776-486e-b6de-bf687af52e7c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:13.119974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1002/1999] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:12 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:13.125086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8728a-81c3-4792-8d92-51dca8568130 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:13.137325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8728a-81c3-4792-8d92-51dca8568130 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:13.208168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cac21d-3f4f-41ed-a885-12b597980e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:13.209179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cac21d-3f4f-41ed-a885-12b597980e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:13.210184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cac21d-3f4f-41ed-a885-12b597980e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:13.210184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cac21d-3f4f-41ed-a885-12b597980e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:13.211308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cac21d-3f4f-41ed-a885-12b597980e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:13.215032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cac21d-3f4f-41ed-a885-12b597980e50 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:13.246508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 998/2000] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:13 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:13.251092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731a631-3776-486e-b6de-bf687af52e7c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:13.263702 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731a631-3776-486e-b6de-bf687af52e7c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:13.270135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0405e-18fb-478f-bde6-287965a4c94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:13.270741 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0405e-18fb-478f-bde6-287965a4c94e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:13.271184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0405e-18fb-478f-bde6-287965a4c94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:13.271424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0405e-18fb-478f-bde6-287965a4c94e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:13.272230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0405e-18fb-478f-bde6-287965a4c94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:13.274159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0405e-18fb-478f-bde6-287965a4c94e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:13.286876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1003/2001] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:13.291930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cac21d-3f4f-41ed-a885-12b597980e50 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:13.304010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cac21d-3f4f-41ed-a885-12b597980e50 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:13.309678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753886a5-fe61-4c5a-8bd5-749b95778009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:13.310523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753886a5-fe61-4c5a-8bd5-749b95778009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:13.310805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753886a5-fe61-4c5a-8bd5-749b95778009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:13.311131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753886a5-fe61-4c5a-8bd5-749b95778009 admin admin] PATH_INFO: `/v3/projects/491399ac7d9246a1afe712651afe659b/users/4027121a4f89438989854bca8368043b/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:13.331570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753886a5-fe61-4c5a-8bd5-749b95778009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491399ac7d9246a1afe712651afe659b, user_id=4027121a4f89438989854bca8368043b, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:13.334332 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753886a5-fe61-4c5a-8bd5-749b95778009 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:13.352503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 999/2002] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:13 2022] PUT /identity/v3/projects/491399ac7d9246a1afe712651afe659b/users/4027121a4f89438989854bca8368043b/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:13.356814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0405e-18fb-478f-bde6-287965a4c94e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:13.373575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0405e-18fb-478f-bde6-287965a4c94e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:13.437842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e82d32-f150-4370-a250-8ab4d125551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:13.438591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e82d32-f150-4370-a250-8ab4d125551d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:13.438875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e82d32-f150-4370-a250-8ab4d125551d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:13.439174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e82d32-f150-4370-a250-8ab4d125551d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:13.439960 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e82d32-f150-4370-a250-8ab4d125551d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:13.441691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e82d32-f150-4370-a250-8ab4d125551d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:13.456504 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1004/2003] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:13.460913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753886a5-fe61-4c5a-8bd5-749b95778009 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:13.472525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753886a5-fe61-4c5a-8bd5-749b95778009 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:13.477807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ee7a1-56df-4206-8124-24922bdd0618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:13.478550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ee7a1-56df-4206-8124-24922bdd0618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:13.478868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ee7a1-56df-4206-8124-24922bdd0618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:13.479207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ee7a1-56df-4206-8124-24922bdd0618 admin admin] PATH_INFO: `/v3/projects/491399ac7d9246a1afe712651afe659b/users/4027121a4f89438989854bca8368043b/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:13.481525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ee7a1-56df-4206-8124-24922bdd0618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491399ac7d9246a1afe712651afe659b, user_id=4027121a4f89438989854bca8368043b, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:13.484288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ee7a1-56df-4206-8124-24922bdd0618 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:13.496922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1000/2004] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:13 2022] PUT /identity/v3/projects/491399ac7d9246a1afe712651afe659b/users/4027121a4f89438989854bca8368043b/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:13.507775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfab4-4466-4226-836e-1bc37ca3ae44 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:13.508440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfab4-4466-4226-836e-1bc37ca3ae44 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:13.508440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfab4-4466-4226-836e-1bc37ca3ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:13.539160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-198dfab4-4466-4226-836e-1bc37ca3ae44 None None] MFA Rules not processed for user `4027121a4f89438989854bca8368043b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:13.540402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-198dfab4-4466-4226-836e-1bc37ca3ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:13.616402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:13.630708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1005/2005] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:13.642735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ee7a1-56df-4206-8124-24922bdd0618 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:13.644761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b80ee7a1-56df-4206-8124-24922bdd0618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:13.666858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:13.782121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ee7a1-56df-4206-8124-24922bdd0618 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:13.786498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b62f00-6407-48f3-a418-70136ae5dcaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:13.787232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b62f00-6407-48f3-a418-70136ae5dcaf service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:13.788593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b62f00-6407-48f3-a418-70136ae5dcaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:13.788593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b62f00-6407-48f3-a418-70136ae5dcaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:13.812519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b62f00-6407-48f3-a418-70136ae5dcaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:13.814290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b62f00-6407-48f3-a418-70136ae5dcaf service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:13.826590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1001/2006] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:14.760106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dfab4-4466-4226-836e-1bc37ca3ae44 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:14.892436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dfab4-4466-4226-836e-1bc37ca3ae44 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:14.897742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:14.898421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:14.898698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:14.898961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] PATH_INFO: `/v3/users/8d770fcfd9354ebf8667b3fafe61dac3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:14.900309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d770fcfd9354ebf8667b3fafe61dac3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:14.902367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:14.980483 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d770fcfd9354ebf8667b3fafe61dac3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:14.981347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d770fcfd9354ebf8667b3fafe61dac3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:14.982288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d770fcfd9354ebf8667b3fafe61dac3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:14.999929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d770fcfd9354ebf8667b3fafe61dac3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:15.015659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d770fcfd9354ebf8667b3fafe61dac3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:15.039569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1006/2007] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:14 2022] DELETE /identity/v3/users/8d770fcfd9354ebf8667b3fafe61dac3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:15.050631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8fd7-a9b6-4199-8467-c478bd0cd3a9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:15.051252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8fd7-a9b6-4199-8467-c478bd0cd3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:15.051496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8fd7-a9b6-4199-8467-c478bd0cd3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:15.088841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-503a8fd7-a9b6-4199-8467-c478bd0cd3a9 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:15.091152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-503a8fd7-a9b6-4199-8467-c478bd0cd3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:15.216461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1002/2008] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:15.232925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:15.235610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:15.356025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5286-f445-4732-ba9b-6d81283a31fd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:15.360913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a97e7-ef75-4322-ad3e-95f8fecd029e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:15.361725 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a97e7-ef75-4322-ad3e-95f8fecd029e service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:15.362148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a97e7-ef75-4322-ad3e-95f8fecd029e service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:15.362507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a97e7-ef75-4322-ad3e-95f8fecd029e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:15.374603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a97e7-ef75-4322-ad3e-95f8fecd029e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:15.376300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a97e7-ef75-4322-ad3e-95f8fecd029e service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:15.388043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1007/2009] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:29:15.784070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a8fd7-a9b6-4199-8467-c478bd0cd3a9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:15.786110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-503a8fd7-a9b6-4199-8467-c478bd0cd3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:15.799539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a8fd7-a9b6-4199-8467-c478bd0cd3a9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:15.805736 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:15.806415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:15.807442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:15.807442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] PATH_INFO: `/v3/projects/9db051a5c77544938c0a15a9078db41b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:15.808344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db051a5c77544938c0a15a9078db41b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:15.810527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:15.868186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db051a5c77544938c0a15a9078db41b', 'request_id': 'req-25106c2f-42be-4f8e-bcc0-35113f2acaa5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:15.878555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db051a5c77544938c0a15a9078db41b', 'request_id': 'req-25106c2f-42be-4f8e-bcc0-35113f2acaa5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:15.886471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db051a5c77544938c0a15a9078db41b', 'request_id': 'req-25106c2f-42be-4f8e-bcc0-35113f2acaa5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:15.899852 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] The token cache is being invalidate because project 9db051a5c77544938c0a15a9078db41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:15.900154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:15.900883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:15.902545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1003/2010] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:15 2022] DELETE /identity/v3/projects/9db051a5c77544938c0a15a9078db41b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:15.907187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a97e7-ef75-4322-ad3e-95f8fecd029e service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:15.918989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a97e7-ef75-4322-ad3e-95f8fecd029e service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:15.941082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:15.996775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:15.997510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:15.997792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:15.998067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] PATH_INFO: `/v3/users/4027121a4f89438989854bca8368043b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:15.999389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4027121a4f89438989854bca8368043b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:16.001522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:16.061174 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4027121a4f89438989854bca8368043b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.061805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4027121a4f89438989854bca8368043b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.062461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4027121a4f89438989854bca8368043b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.080067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4027121a4f89438989854bca8368043b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.090691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4027121a4f89438989854bca8368043b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.107505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1008/2011] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:15 2022] DELETE /identity/v3/users/4027121a4f89438989854bca8368043b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:16.474616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:16.477147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:16.507414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25106c2f-42be-4f8e-bcc0-35113f2acaa5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:16.560715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:16.576583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:16.581014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:16.594545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:16.596530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:16.597106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:16.598446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] PATH_INFO: `/v3/projects/491399ac7d9246a1afe712651afe659b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:16.601734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491399ac7d9246a1afe712651afe659b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:16.605349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:16.730842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98225341-b402-43f9-9691-8c3c02fcfad0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:16.732186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491399ac7d9246a1afe712651afe659b', 'request_id': 'req-9c152057-1e9d-4225-b8d8-6f9c9c301254'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.753323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491399ac7d9246a1afe712651afe659b', 'request_id': 'req-9c152057-1e9d-4225-b8d8-6f9c9c301254'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.773208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491399ac7d9246a1afe712651afe659b', 'request_id': 'req-9c152057-1e9d-4225-b8d8-6f9c9c301254'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.803252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] The token cache is being invalidate because project 491399ac7d9246a1afe712651afe659b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:16.803738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.805112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9c152057-1e9d-4225-b8d8-6f9c9c301254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.811782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1004/2012] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:16 2022] DELETE /identity/v3/projects/491399ac7d9246a1afe712651afe659b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:16.814420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efbef-2cad-4b62-b00c-ddee589e4a82 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:16.814890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efbef-2cad-4b62-b00c-ddee589e4a82 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:16.815545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efbef-2cad-4b62-b00c-ddee589e4a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:16.838071 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:16.864245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:16.865326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:16.865724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:16.865856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] PATH_INFO: `/v3/users/67d358579a714c5898cf310c11286ed5` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:16.866939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b25efbef-2cad-4b62-b00c-ddee589e4a82 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:16.868330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d358579a714c5898cf310c11286ed5)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:16.870657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b25efbef-2cad-4b62-b00c-ddee589e4a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:16.871220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:16.889143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1005/2013] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:16.898993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71c5c-7f21-45e8-9431-248798fe15ed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:16.899335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71c5c-7f21-45e8-9431-248798fe15ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:16.899533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71c5c-7f21-45e8-9431-248798fe15ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:16.941451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-67b71c5c-7f21-45e8-9431-248798fe15ed None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:16.945035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-67b71c5c-7f21-45e8-9431-248798fe15ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:16.954402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d358579a714c5898cf310c11286ed5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.955731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d358579a714c5898cf310c11286ed5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.956433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d358579a714c5898cf310c11286ed5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.958290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1006/2014] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:16.962906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71c5c-7f21-45e8-9431-248798fe15ed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:16.974262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71c5c-7f21-45e8-9431-248798fe15ed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:16.980841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d358579a714c5898cf310c11286ed5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.983480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:16.985089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:16.985668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:16.986323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:16.987497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:16.987981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:16.990691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d926bb3-3f95-467b-8e1f-5ce1b83b34b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d358579a714c5898cf310c11286ed5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:16.991122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:17.009364 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1009/2015] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:16 2022] DELETE /identity/v3/users/67d358579a714c5898cf310c11286ed5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:17.014387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c12352-4118-4fa2-80a6-973bdaf7f1a1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.014955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c12352-4118-4fa2-80a6-973bdaf7f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.015305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c12352-4118-4fa2-80a6-973bdaf7f1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.017319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1007/2016] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:17.023080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:17.026766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:17.043654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c4c12352-4118-4fa2-80a6-973bdaf7f1a1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:17.045803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4c12352-4118-4fa2-80a6-973bdaf7f1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:17.053447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417606b5-3a52-419b-8e0c-5d0564435290 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:17.153009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72326767-0f8d-4e96-9a18-b803a359089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:17.153820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72326767-0f8d-4e96-9a18-b803a359089b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.154103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72326767-0f8d-4e96-9a18-b803a359089b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.156024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72326767-0f8d-4e96-9a18-b803a359089b admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.156831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72326767-0f8d-4e96-9a18-b803a359089b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:17.159178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72326767-0f8d-4e96-9a18-b803a359089b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:17.174324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1010/2017] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:17.189532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c12352-4118-4fa2-80a6-973bdaf7f1a1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:17.193388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4c12352-4118-4fa2-80a6-973bdaf7f1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:17.207054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1008/2018] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:17 2022] POST /identity/v3/projects => generated 353 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:17.211440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72326767-0f8d-4e96-9a18-b803a359089b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:17.257338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:17.285688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c12352-4118-4fa2-80a6-973bdaf7f1a1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:17.321985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72326767-0f8d-4e96-9a18-b803a359089b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:17.322547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:17.330252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8994a4-9087-4cac-9d4e-e9af09b4308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:17.331121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8994a4-9087-4cac-9d4e-e9af09b4308b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.331465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8994a4-9087-4cac-9d4e-e9af09b4308b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.331816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8994a4-9087-4cac-9d4e-e9af09b4308b admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.332986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8994a4-9087-4cac-9d4e-e9af09b4308b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:17.335842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8994a4-9087-4cac-9d4e-e9af09b4308b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:17.358984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a07272-d9a9-4e56-be42-e6927981727e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:17.359905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a07272-d9a9-4e56-be42-e6927981727e service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.360311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a07272-d9a9-4e56-be42-e6927981727e service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.360991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a07272-d9a9-4e56-be42-e6927981727e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.366873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1009/2019] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:17 2022] POST /identity/v3/users => generated 277 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:17.371467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8994a4-9087-4cac-9d4e-e9af09b4308b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:17.377702 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a07272-d9a9-4e56-be42-e6927981727e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:17.380243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a07272-d9a9-4e56-be42-e6927981727e service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:17.382600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8994a4-9087-4cac-9d4e-e9af09b4308b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:17.388245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f54006-65b8-4a45-8174-10ddecced00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:17.389473 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f54006-65b8-4a45-8174-10ddecced00f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.389936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f54006-65b8-4a45-8174-10ddecced00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.390418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f54006-65b8-4a45-8174-10ddecced00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.391440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f54006-65b8-4a45-8174-10ddecced00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:17.393500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f54006-65b8-4a45-8174-10ddecced00f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:17.398317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1011/2020] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:17.407787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1010/2021] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:17.413476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a07272-d9a9-4e56-be42-e6927981727e service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:17.426415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a07272-d9a9-4e56-be42-e6927981727e service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:17.432401 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8725a-c799-43a4-9c32-932a0ac27f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:17.433143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8725a-c799-43a4-9c32-932a0ac27f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.433658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8725a-c799-43a4-9c32-932a0ac27f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.434085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8725a-c799-43a4-9c32-932a0ac27f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.435070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8725a-c799-43a4-9c32-932a0ac27f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:17.437818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8725a-c799-43a4-9c32-932a0ac27f05 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:17.452564 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1012/2022] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:17.458031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f54006-65b8-4a45-8174-10ddecced00f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:17.470562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f54006-65b8-4a45-8174-10ddecced00f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:17.475690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec1a28-0f59-4513-9c5d-a0264c561915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:17.476605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec1a28-0f59-4513-9c5d-a0264c561915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.476760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec1a28-0f59-4513-9c5d-a0264c561915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.476957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec1a28-0f59-4513-9c5d-a0264c561915 admin admin] PATH_INFO: `/v3/projects/a95effb382e0496d9c9929aa9686578f/users/59066f614e524da1b9395429a12e8145/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.497378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec1a28-0f59-4513-9c5d-a0264c561915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95effb382e0496d9c9929aa9686578f, user_id=59066f614e524da1b9395429a12e8145, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:17.500748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec1a28-0f59-4513-9c5d-a0264c561915 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:17.519242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1011/2023] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:17 2022] PUT /identity/v3/projects/a95effb382e0496d9c9929aa9686578f/users/59066f614e524da1b9395429a12e8145/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:17.530808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80262936-e193-459e-bc4e-8d249be91363 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.531171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80262936-e193-459e-bc4e-8d249be91363 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.531563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80262936-e193-459e-bc4e-8d249be91363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.574167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-80262936-e193-459e-bc4e-8d249be91363 None None] MFA Rules not processed for user `59066f614e524da1b9395429a12e8145`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:17.575785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-80262936-e193-459e-bc4e-8d249be91363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:17.707238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1013/2024] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:17 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:17.714043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec1a28-0f59-4513-9c5d-a0264c561915 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:17.794541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80262936-e193-459e-bc4e-8d249be91363 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:17.796453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-80262936-e193-459e-bc4e-8d249be91363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:17.814790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec1a28-0f59-4513-9c5d-a0264c561915 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:17.820365 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92b87-6cc1-40be-b37e-e7450a92b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:17.821029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92b87-6cc1-40be-b37e-e7450a92b1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.821343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92b87-6cc1-40be-b37e-e7450a92b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.821625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92b87-6cc1-40be-b37e-e7450a92b1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.822398 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80262936-e193-459e-bc4e-8d249be91363 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:17.822570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f92b87-6cc1-40be-b37e-e7450a92b1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:17.824508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f92b87-6cc1-40be-b37e-e7450a92b1a8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:17.829822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:17.831779 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.832264 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.833234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] PATH_INFO: `/v3/projects/698657a0c8fc4b8ca28b821ce7985f06` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.836264 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698657a0c8fc4b8ca28b821ce7985f06)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:17.839553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:17.863203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1012/2025] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:17 2022] POST /identity/v3/projects => generated 355 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:17.867610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92b87-6cc1-40be-b37e-e7450a92b1a8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:17.923031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698657a0c8fc4b8ca28b821ce7985f06', 'request_id': 'req-dc4bed0c-8034-4020-b5ef-22e967e80213'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:17.936864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698657a0c8fc4b8ca28b821ce7985f06', 'request_id': 'req-dc4bed0c-8034-4020-b5ef-22e967e80213'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:17.946918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698657a0c8fc4b8ca28b821ce7985f06', 'request_id': 'req-dc4bed0c-8034-4020-b5ef-22e967e80213'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:17.963856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] The token cache is being invalidate because project 698657a0c8fc4b8ca28b821ce7985f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:17.964799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:17.966282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc4bed0c-8034-4020-b5ef-22e967e80213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:17.968239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1014/2026] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:17 2022] DELETE /identity/v3/projects/698657a0c8fc4b8ca28b821ce7985f06 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:17.969559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92b87-6cc1-40be-b37e-e7450a92b1a8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:17.975844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60a031-6c32-4367-a780-19a360b89732 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:17.976948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60a031-6c32-4367-a780-19a360b89732 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:17.977457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60a031-6c32-4367-a780-19a360b89732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:17.987936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:18.028175 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cf60a031-6c32-4367-a780-19a360b89732 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:18.030409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cf60a031-6c32-4367-a780-19a360b89732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:18.053715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d61cfe-4df7-42dd-b0af-a9d4497a3119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.054763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d61cfe-4df7-42dd-b0af-a9d4497a3119 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.055359 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d61cfe-4df7-42dd-b0af-a9d4497a3119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.056011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d61cfe-4df7-42dd-b0af-a9d4497a3119 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.056893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d61cfe-4df7-42dd-b0af-a9d4497a3119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.059125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d61cfe-4df7-42dd-b0af-a9d4497a3119 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.078843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:18.093865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1013/2027] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:17 2022] POST /identity/v3/users => generated 284 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:18.096089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d61cfe-4df7-42dd-b0af-a9d4497a3119 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.098945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-60d61cfe-4df7-42dd-b0af-a9d4497a3119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:18.119072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d61cfe-4df7-42dd-b0af-a9d4497a3119 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.127054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea56369-57f6-41b4-ac8e-142a4f9d8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.128701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea56369-57f6-41b4-ac8e-142a4f9d8020 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.129187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea56369-57f6-41b4-ac8e-142a4f9d8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.129516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea56369-57f6-41b4-ac8e-142a4f9d8020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.130493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea56369-57f6-41b4-ac8e-142a4f9d8020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.132838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea56369-57f6-41b4-ac8e-142a4f9d8020 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.142062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1015/2028] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:18.143998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0154f-c64e-4c85-b0a3-9bfc4fbb7a6d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.144365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0154f-c64e-4c85-b0a3-9bfc4fbb7a6d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.144657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0154f-c64e-4c85-b0a3-9bfc4fbb7a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.148826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1014/2029] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:18.150936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea56369-57f6-41b4-ac8e-142a4f9d8020 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.161914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea56369-57f6-41b4-ac8e-142a4f9d8020 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.167879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82cb78-e0d7-4e67-b0c5-0b266122e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.168936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82cb78-e0d7-4e67-b0c5-0b266122e456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.169329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82cb78-e0d7-4e67-b0c5-0b266122e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.169619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82cb78-e0d7-4e67-b0c5-0b266122e456 admin admin] PATH_INFO: `/v3/projects/f51c932d91de483fb130f27d8079ef1c/users/a4fefeb70d8d43e2af2fb0dba0043010/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.171757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3fd0154f-c64e-4c85-b0a3-9bfc4fbb7a6d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:18.175110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3fd0154f-c64e-4c85-b0a3-9bfc4fbb7a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:18.198129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82cb78-e0d7-4e67-b0c5-0b266122e456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51c932d91de483fb130f27d8079ef1c, user_id=a4fefeb70d8d43e2af2fb0dba0043010, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.199261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1016/2030] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:18.202550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82cb78-e0d7-4e67-b0c5-0b266122e456 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.205095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0154f-c64e-4c85-b0a3-9bfc4fbb7a6d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.225475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0154f-c64e-4c85-b0a3-9bfc4fbb7a6d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.230162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1015/2031] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:18 2022] PUT /identity/v3/projects/f51c932d91de483fb130f27d8079ef1c/users/a4fefeb70d8d43e2af2fb0dba0043010/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:18.235048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82cb78-e0d7-4e67-b0c5-0b266122e456 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.346316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999505f6-dc8b-47da-929c-a3c46f81ca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.347317 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82cb78-e0d7-4e67-b0c5-0b266122e456 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.347595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999505f6-dc8b-47da-929c-a3c46f81ca69 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.348235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999505f6-dc8b-47da-929c-a3c46f81ca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.348814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999505f6-dc8b-47da-929c-a3c46f81ca69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.350426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999505f6-dc8b-47da-929c-a3c46f81ca69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:18.351057 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999505f6-dc8b-47da-929c-a3c46f81ca69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.353091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f36a2-cf51-40c9-865b-7af41feebd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.353769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f36a2-cf51-40c9-865b-7af41feebd9b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.354061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f36a2-cf51-40c9-865b-7af41feebd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.354388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f36a2-cf51-40c9-865b-7af41feebd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.354523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999505f6-dc8b-47da-929c-a3c46f81ca69 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.355029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f36a2-cf51-40c9-865b-7af41feebd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.356930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f36a2-cf51-40c9-865b-7af41feebd9b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.372594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1017/2032] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:29:18.377289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999505f6-dc8b-47da-929c-a3c46f81ca69 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.384874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1016/2033] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:18.388643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999505f6-dc8b-47da-929c-a3c46f81ca69 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.392604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f36a2-cf51-40c9-865b-7af41feebd9b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.394553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599105d-2e9f-424d-8149-5a34b58c45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.395350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599105d-2e9f-424d-8149-5a34b58c45e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.395696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599105d-2e9f-424d-8149-5a34b58c45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.395993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599105d-2e9f-424d-8149-5a34b58c45e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.396871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599105d-2e9f-424d-8149-5a34b58c45e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.409423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599105d-2e9f-424d-8149-5a34b58c45e1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.413107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f36a2-cf51-40c9-865b-7af41feebd9b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.423192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755251f-81b5-4fb6-8a2c-ae06268a3ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.424526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755251f-81b5-4fb6-8a2c-ae06268a3ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.425169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755251f-81b5-4fb6-8a2c-ae06268a3ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.425890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755251f-81b5-4fb6-8a2c-ae06268a3ed2 admin admin] PATH_INFO: `/v3/projects/f51c932d91de483fb130f27d8079ef1c/users/a4fefeb70d8d43e2af2fb0dba0043010/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.428541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755251f-81b5-4fb6-8a2c-ae06268a3ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51c932d91de483fb130f27d8079ef1c, user_id=a4fefeb70d8d43e2af2fb0dba0043010, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.432055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755251f-81b5-4fb6-8a2c-ae06268a3ed2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.447787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1017/2034] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:18 2022] PUT /identity/v3/projects/f51c932d91de483fb130f27d8079ef1c/users/a4fefeb70d8d43e2af2fb0dba0043010/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:18.464961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1018/2035] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:18 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:18.468489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7862a-7a65-4dd7-b9ca-c4253ac69cff None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.468861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7862a-7a65-4dd7-b9ca-c4253ac69cff None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.469209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7862a-7a65-4dd7-b9ca-c4253ac69cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.470444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599105d-2e9f-424d-8149-5a34b58c45e1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.502817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3fd7862a-7a65-4dd7-b9ca-c4253ac69cff None None] MFA Rules not processed for user `a4fefeb70d8d43e2af2fb0dba0043010`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:18.504178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3fd7862a-7a65-4dd7-b9ca-c4253ac69cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:18.577473 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:18.628740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599105d-2e9f-424d-8149-5a34b58c45e1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.637421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365202ad-fefe-4921-94b5-419b94cd8021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.638155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1018/2036] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:18 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:18.638504 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365202ad-fefe-4921-94b5-419b94cd8021 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.638928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365202ad-fefe-4921-94b5-419b94cd8021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.639259 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365202ad-fefe-4921-94b5-419b94cd8021 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.640026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365202ad-fefe-4921-94b5-419b94cd8021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.642291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365202ad-fefe-4921-94b5-419b94cd8021 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.659167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7862a-7a65-4dd7-b9ca-c4253ac69cff None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.661109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3fd7862a-7a65-4dd7-b9ca-c4253ac69cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:18.669351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1019/2037] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:18 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:18.676780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365202ad-fefe-4921-94b5-419b94cd8021 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.696370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365202ad-fefe-4921-94b5-419b94cd8021 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.705621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d950f-e43d-451b-b34d-8060df922e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.706695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d950f-e43d-451b-b34d-8060df922e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.707140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d950f-e43d-451b-b34d-8060df922e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.707592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d950f-e43d-451b-b34d-8060df922e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.708767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d950f-e43d-451b-b34d-8060df922e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.711651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d950f-e43d-451b-b34d-8060df922e3a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.729824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1020/2038] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:18.731419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d950f-e43d-451b-b34d-8060df922e3a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.744271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d950f-e43d-451b-b34d-8060df922e3a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.750809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a9a37-6626-47ff-b9f0-b75c246e9ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.751781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a9a37-6626-47ff-b9f0-b75c246e9ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.752191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a9a37-6626-47ff-b9f0-b75c246e9ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.752635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a9a37-6626-47ff-b9f0-b75c246e9ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.753708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a9a37-6626-47ff-b9f0-b75c246e9ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.755897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7862a-7a65-4dd7-b9ca-c4253ac69cff None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.756169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a9a37-6626-47ff-b9f0-b75c246e9ffb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.759881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f74db9-498f-4efe-895c-09c3ee8645cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.760548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f74db9-498f-4efe-895c-09c3ee8645cd service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.760824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f74db9-498f-4efe-895c-09c3ee8645cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.761092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f74db9-498f-4efe-895c-09c3ee8645cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.772806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1021/2039] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:18.777144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f74db9-498f-4efe-895c-09c3ee8645cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.777780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a9a37-6626-47ff-b9f0-b75c246e9ffb admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:18.779373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f74db9-498f-4efe-895c-09c3ee8645cd service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.783614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:18.796367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1019/2040] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:18 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:29:18.796880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a9a37-6626-47ff-b9f0-b75c246e9ffb admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:18.807231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83f47-7180-483e-b71c-d9cdeeeb45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:18.808382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83f47-7180-483e-b71c-d9cdeeeb45af admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.809226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83f47-7180-483e-b71c-d9cdeeeb45af admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.809798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83f47-7180-483e-b71c-d9cdeeeb45af admin admin] PATH_INFO: `/v3/projects/71d978db57bb4c8d81a6786f469e0a46/users/b14495a2b79d417f9ced7aed9f668e87/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.833329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f83f47-7180-483e-b71c-d9cdeeeb45af admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d978db57bb4c8d81a6786f469e0a46, user_id=b14495a2b79d417f9ced7aed9f668e87, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:18.836657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f83f47-7180-483e-b71c-d9cdeeeb45af admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:18.855089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1022/2041] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:18 2022] PUT /identity/v3/projects/71d978db57bb4c8d81a6786f469e0a46/users/b14495a2b79d417f9ced7aed9f668e87/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:18.872072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343ddf-3577-4638-b7dd-0f23eaf4ac65 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:18.872631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343ddf-3577-4638-b7dd-0f23eaf4ac65 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:18.873069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343ddf-3577-4638-b7dd-0f23eaf4ac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:18.922227 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7e343ddf-3577-4638-b7dd-0f23eaf4ac65 None None] MFA Rules not processed for user `b14495a2b79d417f9ced7aed9f668e87`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:18.923608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7e343ddf-3577-4638-b7dd-0f23eaf4ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:18.937219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83f47-7180-483e-b71c-d9cdeeeb45af admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:19.005516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83f47-7180-483e-b71c-d9cdeeeb45af admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:19.009731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b0cb6-0407-4d7f-9880-3b0073577561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:19.010384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b0cb6-0407-4d7f-9880-3b0073577561 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:19.010675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b0cb6-0407-4d7f-9880-3b0073577561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:19.010944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b0cb6-0407-4d7f-9880-3b0073577561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:19.013050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-693b0cb6-0407-4d7f-9880-3b0073577561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:19.017533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1020/2042] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:19.033866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e343ddf-3577-4638-b7dd-0f23eaf4ac65 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:19.035896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7e343ddf-3577-4638-b7dd-0f23eaf4ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:19.116070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b0cb6-0407-4d7f-9880-3b0073577561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:19.117887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b0cb6-0407-4d7f-9880-3b0073577561 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:19.130018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1023/2043] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:18 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:19.162760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e343ddf-3577-4638-b7dd-0f23eaf4ac65 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:19.168813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6b928-5078-4894-9074-6a116c504bf0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb8054ea4249d18903b5998fa753d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:19.169944 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b928-5078-4894-9074-6a116c504bf0 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:19.170406 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b928-5078-4894-9074-6a116c504bf0 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:19.170867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b928-5078-4894-9074-6a116c504bf0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:19.180326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:19.184991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6b928-5078-4894-9074-6a116c504bf0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:19.187837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6b928-5078-4894-9074-6a116c504bf0 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:19.204431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1021/2044] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:29.124357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:29.196383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:33.501962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a53f32-52ff-4a74-b03f-98de599a7abc None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:33.502902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a53f32-52ff-4a74-b03f-98de599a7abc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:33.503378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a53f32-52ff-4a74-b03f-98de599a7abc None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:33.505385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1024/2045] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:29:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:29:33.532899 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f46a-cc91-4ca2-8a6a-bfa5c9aa34e8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:33.538371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f46a-cc91-4ca2-8a6a-bfa5c9aa34e8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:33.538798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f46a-cc91-4ca2-8a6a-bfa5c9aa34e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:33.565630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3054f46a-cc91-4ca2-8a6a-bfa5c9aa34e8 None None] MFA Rules not processed for user `826fd481bf2e40d6917bb604591a75cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:33.566991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3054f46a-cc91-4ca2-8a6a-bfa5c9aa34e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:33.570678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a53f32-52ff-4a74-b03f-98de599a7abc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:33.573173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-18a53f32-52ff-4a74-b03f-98de599a7abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:33.648079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1022/2046] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:29:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:33.658540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a53f32-52ff-4a74-b03f-98de599a7abc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:33.663310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:33.664016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:33.664115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f46a-cc91-4ca2-8a6a-bfa5c9aa34e8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:33.664306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:33.664974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] PATH_INFO: `/v3/users/a21fa57fe1e34f999220a36c8b162dfb` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:33.665930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3054f46a-cc91-4ca2-8a6a-bfa5c9aa34e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:33.666199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21fa57fe1e34f999220a36c8b162dfb)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:33.669205 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:33.679293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f46a-cc91-4ca2-8a6a-bfa5c9aa34e8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:33.685254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ffae8-08b9-4b41-a789-6b74089b2bb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:33.685965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ffae8-08b9-4b41-a789-6b74089b2bb9 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:33.686249 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ffae8-08b9-4b41-a789-6b74089b2bb9 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:33.686524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ffae8-08b9-4b41-a789-6b74089b2bb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:33.696053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ffae8-08b9-4b41-a789-6b74089b2bb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:33.697788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ffae8-08b9-4b41-a789-6b74089b2bb9 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:33.710792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1023/2047] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:33.753321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21fa57fe1e34f999220a36c8b162dfb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:33.754522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21fa57fe1e34f999220a36c8b162dfb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:33.755266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21fa57fe1e34f999220a36c8b162dfb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:33.768638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21fa57fe1e34f999220a36c8b162dfb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:33.778161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21fa57fe1e34f999220a36c8b162dfb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:33.792614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1025/2048] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:33 2022] DELETE /identity/v3/users/a21fa57fe1e34f999220a36c8b162dfb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:34.025590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ffae8-08b9-4b41-a789-6b74089b2bb9 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:34.036577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ffae8-08b9-4b41-a789-6b74089b2bb9 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:34.129238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:34.129978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:34.130244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:34.130516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] PATH_INFO: `/v3/projects/efdca505ccaf4085b2fb946514d208ab` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:34.131745 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efdca505ccaf4085b2fb946514d208ab)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:34.133904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:34.187116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efdca505ccaf4085b2fb946514d208ab', 'request_id': 'req-fd6566af-303d-4206-8059-e86c8153dc40'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.195482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efdca505ccaf4085b2fb946514d208ab', 'request_id': 'req-fd6566af-303d-4206-8059-e86c8153dc40'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.201135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efdca505ccaf4085b2fb946514d208ab', 'request_id': 'req-fd6566af-303d-4206-8059-e86c8153dc40'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.213386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] The token cache is being invalidate because project efdca505ccaf4085b2fb946514d208ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:34.213708 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.214322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.216395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1024/2049] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:34 2022] DELETE /identity/v3/projects/efdca505ccaf4085b2fb946514d208ab => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:34.220615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:34.222219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:34.237509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50f37-de59-4751-b944-94c8fe29d4e8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:34.302867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:34.303671 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:34.303947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:34.304370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] PATH_INFO: `/v3/users/aa6d77b0e2f64040b7334f1933f0dfe9` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:34.305685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6d77b0e2f64040b7334f1933f0dfe9)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:34.307640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:34.336597 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:34.370834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6d77b0e2f64040b7334f1933f0dfe9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.371514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6d77b0e2f64040b7334f1933f0dfe9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.372484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6d77b0e2f64040b7334f1933f0dfe9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.386680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6d77b0e2f64040b7334f1933f0dfe9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.394093 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7010713d-ebfd-42ef-ad76-5dbca54c1135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6d77b0e2f64040b7334f1933f0dfe9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.406570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1026/2050] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:34 2022] DELETE /identity/v3/users/aa6d77b0e2f64040b7334f1933f0dfe9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:34.616807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:34.618533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:34.652212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6566af-303d-4206-8059-e86c8153dc40 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:34.673792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:34.760723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:34.762400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:34.762775 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:34.765767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] PATH_INFO: `/v3/projects/f46ca5c544b94a879c704ba13eb5d27d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:34.767533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46ca5c544b94a879c704ba13eb5d27d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:34.775117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:34.839176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46ca5c544b94a879c704ba13eb5d27d', 'request_id': 'req-08bde2d6-847d-479d-a4c0-541f4603badd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.853021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46ca5c544b94a879c704ba13eb5d27d', 'request_id': 'req-08bde2d6-847d-479d-a4c0-541f4603badd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.862366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46ca5c544b94a879c704ba13eb5d27d', 'request_id': 'req-08bde2d6-847d-479d-a4c0-541f4603badd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.889930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] The token cache is being invalidate because project f46ca5c544b94a879c704ba13eb5d27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:34.890221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.891466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:34.901362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1025/2051] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:34 2022] DELETE /identity/v3/projects/f46ca5c544b94a879c704ba13eb5d27d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:34.902525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717627a-2746-465c-ad21-86173f329e25 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:34.903347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717627a-2746-465c-ad21-86173f329e25 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:34.903625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717627a-2746-465c-ad21-86173f329e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:34.942391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3717627a-2746-465c-ad21-86173f329e25 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:34.943660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3717627a-2746-465c-ad21-86173f329e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:34.964036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:34.965539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:35.026085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1027/2052] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:35.033991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0711ef7-c57c-4f6c-a4b7-be618b0000dd None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.034918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0711ef7-c57c-4f6c-a4b7-be618b0000dd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.035204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0711ef7-c57c-4f6c-a4b7-be618b0000dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.037991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde2d6-847d-479d-a4c0-541f4603badd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.043691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.044654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.045032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.045418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] PATH_INFO: `/v3/users/59066f614e524da1b9395429a12e8145` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.046679 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=59066f614e524da1b9395429a12e8145)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.049865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.067799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b0711ef7-c57c-4f6c-a4b7-be618b0000dd None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:35.069405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b0711ef7-c57c-4f6c-a4b7-be618b0000dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:35.085547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1028/2053] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:35.090151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0711ef7-c57c-4f6c-a4b7-be618b0000dd None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.100788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0711ef7-c57c-4f6c-a4b7-be618b0000dd None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.105879 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175e22-5525-4cd0-9887-259c7bf9335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.106499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175e22-5525-4cd0-9887-259c7bf9335b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.106777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175e22-5525-4cd0-9887-259c7bf9335b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.107044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175e22-5525-4cd0-9887-259c7bf9335b admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.107750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e175e22-5525-4cd0-9887-259c7bf9335b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:35.108060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e175e22-5525-4cd0-9887-259c7bf9335b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.109701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e175e22-5525-4cd0-9887-259c7bf9335b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.115786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:35.117617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59066f614e524da1b9395429a12e8145'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.122314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1029/2054] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:35.126844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59066f614e524da1b9395429a12e8145'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.127198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175e22-5525-4cd0-9887-259c7bf9335b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.137013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175e22-5525-4cd0-9887-259c7bf9335b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.139975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59066f614e524da1b9395429a12e8145'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.141811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac7069-b795-4b86-a9f9-45afe90c115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.142424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac7069-b795-4b86-a9f9-45afe90c115e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.142718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac7069-b795-4b86-a9f9-45afe90c115e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.143003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac7069-b795-4b86-a9f9-45afe90c115e admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.143687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac7069-b795-4b86-a9f9-45afe90c115e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.145772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac7069-b795-4b86-a9f9-45afe90c115e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.147310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59066f614e524da1b9395429a12e8145'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.148039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b1744f82-eae6-4999-bcd6-2c3dbdbabacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59066f614e524da1b9395429a12e8145'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.154202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1026/2055] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:34 2022] DELETE /identity/v3/users/59066f614e524da1b9395429a12e8145 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:35.159150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310187a-d3b9-46cd-93f3-dab54c74ba84 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.159501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310187a-d3b9-46cd-93f3-dab54c74ba84 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.159782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310187a-d3b9-46cd-93f3-dab54c74ba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.178828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1030/2056] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:35 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:35.181156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3310187a-d3b9-46cd-93f3-dab54c74ba84 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:35.182518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3310187a-d3b9-46cd-93f3-dab54c74ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:35.183017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac7069-b795-4b86-a9f9-45afe90c115e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.184700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b4ac7069-b795-4b86-a9f9-45afe90c115e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:35.252983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1027/2057] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:35.256650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:35.260734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac7069-b795-4b86-a9f9-45afe90c115e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.264361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310187a-d3b9-46cd-93f3-dab54c74ba84 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.265855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3310187a-d3b9-46cd-93f3-dab54c74ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:35.267450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5099d00-c20a-43d9-8806-67a3954e40eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.268162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5099d00-c20a-43d9-8806-67a3954e40eb admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.268480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5099d00-c20a-43d9-8806-67a3954e40eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.268894 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5099d00-c20a-43d9-8806-67a3954e40eb admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.269841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5099d00-c20a-43d9-8806-67a3954e40eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.272252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5099d00-c20a-43d9-8806-67a3954e40eb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.296908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1031/2058] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:35 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:35.301090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5099d00-c20a-43d9-8806-67a3954e40eb admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.311539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5099d00-c20a-43d9-8806-67a3954e40eb admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.320127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19311c95-c479-40a6-80a6-ffb41fd2ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.320662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19311c95-c479-40a6-80a6-ffb41fd2ab6a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.320942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19311c95-c479-40a6-80a6-ffb41fd2ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.321211 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19311c95-c479-40a6-80a6-ffb41fd2ab6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.321999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19311c95-c479-40a6-80a6-ffb41fd2ab6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.323845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19311c95-c479-40a6-80a6-ffb41fd2ab6a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.335129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1032/2059] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:35.337527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310187a-d3b9-46cd-93f3-dab54c74ba84 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.339232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19311c95-c479-40a6-80a6-ffb41fd2ab6a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.341526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66c8f1-2162-419d-9976-a8f7f776eaf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.342186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66c8f1-2162-419d-9976-a8f7f776eaf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.342463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66c8f1-2162-419d-9976-a8f7f776eaf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.342750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66c8f1-2162-419d-9976-a8f7f776eaf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.350546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19311c95-c479-40a6-80a6-ffb41fd2ab6a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.356315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66c8f1-2162-419d-9976-a8f7f776eaf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.357428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fe642-72b6-41e0-a92d-dc187ae74c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.357834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66c8f1-2162-419d-9976-a8f7f776eaf7 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.358439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe642-72b6-41e0-a92d-dc187ae74c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.358900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe642-72b6-41e0-a92d-dc187ae74c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.359229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe642-72b6-41e0-a92d-dc187ae74c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.360125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fe642-72b6-41e0-a92d-dc187ae74c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.361987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fe642-72b6-41e0-a92d-dc187ae74c06 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.369996 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1028/2060] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:35.374934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1033/2061] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:35.379326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66c8f1-2162-419d-9976-a8f7f776eaf7 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.389477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66c8f1-2162-419d-9976-a8f7f776eaf7 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.394330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac2466-94c9-42d1-9102-4ef447cd7350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.395012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac2466-94c9-42d1-9102-4ef447cd7350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.395298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac2466-94c9-42d1-9102-4ef447cd7350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.395575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac2466-94c9-42d1-9102-4ef447cd7350 admin admin] PATH_INFO: `/v3/projects/98420cb82ece4a44a842a080c2a601f9/users/0ce7a111fd6f4943a5f14ccfc18127f2/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.410561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac2466-94c9-42d1-9102-4ef447cd7350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98420cb82ece4a44a842a080c2a601f9, user_id=0ce7a111fd6f4943a5f14ccfc18127f2, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.413306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac2466-94c9-42d1-9102-4ef447cd7350 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.430023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1029/2062] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:35 2022] PUT /identity/v3/projects/98420cb82ece4a44a842a080c2a601f9/users/0ce7a111fd6f4943a5f14ccfc18127f2/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:35.441494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1faa96-ec4c-42c7-bcf1-3ff1c9051515 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.441917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1faa96-ec4c-42c7-bcf1-3ff1c9051515 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.442304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1faa96-ec4c-42c7-bcf1-3ff1c9051515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.473875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1c1faa96-ec4c-42c7-bcf1-3ff1c9051515 None None] MFA Rules not processed for user `0ce7a111fd6f4943a5f14ccfc18127f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:35.475153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1c1faa96-ec4c-42c7-bcf1-3ff1c9051515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:35.550196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1034/2063] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:35.562404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac2466-94c9-42d1-9102-4ef447cd7350 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.564414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3ac2466-94c9-42d1-9102-4ef447cd7350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:35.615713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:35.631255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac2466-94c9-42d1-9102-4ef447cd7350 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.636837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e63f2-2a39-4971-894d-997b9e91092a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.637435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e63f2-2a39-4971-894d-997b9e91092a service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.637717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e63f2-2a39-4971-894d-997b9e91092a service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.637991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e63f2-2a39-4971-894d-997b9e91092a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.647672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e63f2-2a39-4971-894d-997b9e91092a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.649131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e63f2-2a39-4971-894d-997b9e91092a service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.658829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1030/2064] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:35.674567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1faa96-ec4c-42c7-bcf1-3ff1c9051515 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.676718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1c1faa96-ec4c-42c7-bcf1-3ff1c9051515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:35.765197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1faa96-ec4c-42c7-bcf1-3ff1c9051515 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.772898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.773595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.773877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.774148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] PATH_INFO: `/v3/projects/a95effb382e0496d9c9929aa9686578f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.775348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95effb382e0496d9c9929aa9686578f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.777337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:35.834399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95effb382e0496d9c9929aa9686578f', 'request_id': 'req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.844949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95effb382e0496d9c9929aa9686578f', 'request_id': 'req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.847152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:35.858251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95effb382e0496d9c9929aa9686578f', 'request_id': 'req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.875881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] The token cache is being invalidate because project a95effb382e0496d9c9929aa9686578f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:35.876160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.876872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:35.878477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1035/2065] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:35 2022] DELETE /identity/v3/projects/a95effb382e0496d9c9929aa9686578f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:35.883087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e63f2-2a39-4971-894d-997b9e91092a service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:35.895245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e63f2-2a39-4971-894d-997b9e91092a service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:35.975122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:35.975122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:35.975122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:35.975122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] PATH_INFO: `/v3/users/a4fefeb70d8d43e2af2fb0dba0043010` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:35.976337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fefeb70d8d43e2af2fb0dba0043010)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:35.978590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:36.055924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fefeb70d8d43e2af2fb0dba0043010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.065044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fefeb70d8d43e2af2fb0dba0043010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.081718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fefeb70d8d43e2af2fb0dba0043010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.088969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fefeb70d8d43e2af2fb0dba0043010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.089606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b1dac91-3b10-4bc9-8194-33f970df5e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fefeb70d8d43e2af2fb0dba0043010'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.096149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1031/2066] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:35 2022] DELETE /identity/v3/users/a4fefeb70d8d43e2af2fb0dba0043010 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:36.390050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:36.391812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:36.405652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d40e1-1d75-4db2-bdd3-c1a0ef49b202 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:36.468046 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:36.469124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:36.469486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:36.469771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] PATH_INFO: `/v3/projects/f51c932d91de483fb130f27d8079ef1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:36.471025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51c932d91de483fb130f27d8079ef1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:36.472968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:36.526768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51c932d91de483fb130f27d8079ef1c', 'request_id': 'req-a91d2965-30b7-475c-8882-c4b3111966e2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.535466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51c932d91de483fb130f27d8079ef1c', 'request_id': 'req-a91d2965-30b7-475c-8882-c4b3111966e2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.542314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51c932d91de483fb130f27d8079ef1c', 'request_id': 'req-a91d2965-30b7-475c-8882-c4b3111966e2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.554681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] The token cache is being invalidate because project f51c932d91de483fb130f27d8079ef1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:36.554974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.555650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a91d2965-30b7-475c-8882-c4b3111966e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:36.557218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1036/2067] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:36 2022] DELETE /identity/v3/projects/f51c932d91de483fb130f27d8079ef1c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:36.562569 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496381ff-be2c-4762-ab6b-bdf5d8098608 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:36.562950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496381ff-be2c-4762-ab6b-bdf5d8098608 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:36.563347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496381ff-be2c-4762-ab6b-bdf5d8098608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:36.585888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-496381ff-be2c-4762-ab6b-bdf5d8098608 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:36.587090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-496381ff-be2c-4762-ab6b-bdf5d8098608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:36.652982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1032/2068] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:36.661079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9977-181a-4bec-99d2-2ac5096fc056 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:36.661395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9977-181a-4bec-99d2-2ac5096fc056 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:36.661802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9977-181a-4bec-99d2-2ac5096fc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:36.682755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c9de9977-181a-4bec-99d2-2ac5096fc056 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:36.683969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c9de9977-181a-4bec-99d2-2ac5096fc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:36.696391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1037/2069] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:36.698088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496381ff-be2c-4762-ab6b-bdf5d8098608 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:36.705777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:36.710126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496381ff-be2c-4762-ab6b-bdf5d8098608 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:36.719023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ca53-31a2-43b7-9bf4-e6dd9420c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:36.719727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ca53-31a2-43b7-9bf4-e6dd9420c8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:36.720016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ca53-31a2-43b7-9bf4-e6dd9420c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:36.720300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ca53-31a2-43b7-9bf4-e6dd9420c8ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:36.721030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76ca53-31a2-43b7-9bf4-e6dd9420c8ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:36.721394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76ca53-31a2-43b7-9bf4-e6dd9420c8ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:36.723494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76ca53-31a2-43b7-9bf4-e6dd9420c8ad admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:36.736801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1033/2070] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:36.742912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9977-181a-4bec-99d2-2ac5096fc056 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:36.760675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9977-181a-4bec-99d2-2ac5096fc056 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:36.766446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ad4d-a808-4960-b510-de4b37fb3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:36.767097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ad4d-a808-4960-b510-de4b37fb3ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:36.767421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ad4d-a808-4960-b510-de4b37fb3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:36.767694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ad4d-a808-4960-b510-de4b37fb3ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:36.768383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863ad4d-a808-4960-b510-de4b37fb3ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:36.770372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863ad4d-a808-4960-b510-de4b37fb3ef6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:36.807503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1038/2071] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:36 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:36.813633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ca53-31a2-43b7-9bf4-e6dd9420c8ad admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:36.824683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ca53-31a2-43b7-9bf4-e6dd9420c8ad admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:36.895402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8a55-4ae5-47ff-a7db-d6318ea4706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:36.896337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8a55-4ae5-47ff-a7db-d6318ea4706a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:36.896766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8a55-4ae5-47ff-a7db-d6318ea4706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:36.897240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8a55-4ae5-47ff-a7db-d6318ea4706a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:36.898610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8a55-4ae5-47ff-a7db-d6318ea4706a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:36.902265 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8a55-4ae5-47ff-a7db-d6318ea4706a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:36.928914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1034/2072] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:36 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:36.934867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ad4d-a808-4960-b510-de4b37fb3ef6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:36.948568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ad4d-a808-4960-b510-de4b37fb3ef6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:36.956028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c861a-6092-4879-aafe-e44856a1df4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:36.956667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c861a-6092-4879-aafe-e44856a1df4c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:36.956934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c861a-6092-4879-aafe-e44856a1df4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:36.957193 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c861a-6092-4879-aafe-e44856a1df4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:36.958025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c861a-6092-4879-aafe-e44856a1df4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:36.959672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c861a-6092-4879-aafe-e44856a1df4c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:36.971177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1039/2073] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:36.975280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8a55-4ae5-47ff-a7db-d6318ea4706a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:36.986779 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8a55-4ae5-47ff-a7db-d6318ea4706a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:36.992201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3101c-4495-4fd8-8fd0-826e68e903af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:36.992830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3101c-4495-4fd8-8fd0-826e68e903af admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:36.993136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3101c-4495-4fd8-8fd0-826e68e903af admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:36.993446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3101c-4495-4fd8-8fd0-826e68e903af admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:36.994158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3101c-4495-4fd8-8fd0-826e68e903af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:36.995759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3101c-4495-4fd8-8fd0-826e68e903af admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:37.007107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1035/2074] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:37.011578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c861a-6092-4879-aafe-e44856a1df4c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:37.023867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c861a-6092-4879-aafe-e44856a1df4c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:37.029964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e5edb-6adf-4c5f-82f2-ac1f15d3a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:37.030773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e5edb-6adf-4c5f-82f2-ac1f15d3a459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.031069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e5edb-6adf-4c5f-82f2-ac1f15d3a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.031347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e5edb-6adf-4c5f-82f2-ac1f15d3a459 admin admin] PATH_INFO: `/v3/projects/f6c2f4536648450b97709fa77ed4d301/users/69a5457789b74ffe90d6ca7e452ed2da/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.060401 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e5edb-6adf-4c5f-82f2-ac1f15d3a459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c2f4536648450b97709fa77ed4d301, user_id=69a5457789b74ffe90d6ca7e452ed2da, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:37.063558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e5edb-6adf-4c5f-82f2-ac1f15d3a459 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:37.087471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1040/2075] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:37 2022] PUT /identity/v3/projects/f6c2f4536648450b97709fa77ed4d301/users/69a5457789b74ffe90d6ca7e452ed2da/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:37.098084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905d412-20b1-46d0-b7fe-1b3e91b0c5ea None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.098368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905d412-20b1-46d0-b7fe-1b3e91b0c5ea None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.098639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905d412-20b1-46d0-b7fe-1b3e91b0c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.126425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6905d412-20b1-46d0-b7fe-1b3e91b0c5ea None None] MFA Rules not processed for user `69a5457789b74ffe90d6ca7e452ed2da`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:37.127707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6905d412-20b1-46d0-b7fe-1b3e91b0c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:37.200714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1036/2076] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:37.206069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e5edb-6adf-4c5f-82f2-ac1f15d3a459 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:37.219638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:37.283653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e5edb-6adf-4c5f-82f2-ac1f15d3a459 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:37.290130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebec89b-4c25-4dfe-82e7-0abe604e2c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:37.290614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec89b-4c25-4dfe-82e7-0abe604e2c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.290884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec89b-4c25-4dfe-82e7-0abe604e2c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.290997 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec89b-4c25-4dfe-82e7-0abe604e2c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.291753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebec89b-4c25-4dfe-82e7-0abe604e2c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:37.293814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebec89b-4c25-4dfe-82e7-0abe604e2c5b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:37.327737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1041/2077] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:37 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:37.331600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905d412-20b1-46d0-b7fe-1b3e91b0c5ea None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:37.343483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905d412-20b1-46d0-b7fe-1b3e91b0c5ea None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:37.414165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6c7f8-124b-4209-918c-82181beeb72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:37.414728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6c7f8-124b-4209-918c-82181beeb72a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.415462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6c7f8-124b-4209-918c-82181beeb72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.415462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6c7f8-124b-4209-918c-82181beeb72a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.416050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6c7f8-124b-4209-918c-82181beeb72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:37.418054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6c7f8-124b-4209-918c-82181beeb72a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:37.428146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:37.452781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1037/2078] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:37 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:37.456804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebec89b-4c25-4dfe-82e7-0abe604e2c5b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:37.470643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebec89b-4c25-4dfe-82e7-0abe604e2c5b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:37.475402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab543d7-641a-43a6-99ad-33339a199149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:37.476177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab543d7-641a-43a6-99ad-33339a199149 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.476458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab543d7-641a-43a6-99ad-33339a199149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.476733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab543d7-641a-43a6-99ad-33339a199149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.477476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab543d7-641a-43a6-99ad-33339a199149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:37.479096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab543d7-641a-43a6-99ad-33339a199149 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:37.490965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1042/2079] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:37.495304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6c7f8-124b-4209-918c-82181beeb72a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:37.506261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6c7f8-124b-4209-918c-82181beeb72a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:37.512100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059489ff-1048-4c03-8d71-a63acb9c10b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:37.512811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059489ff-1048-4c03-8d71-a63acb9c10b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.513094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059489ff-1048-4c03-8d71-a63acb9c10b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.513409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059489ff-1048-4c03-8d71-a63acb9c10b9 admin admin] PATH_INFO: `/v3/projects/7fb2007b6bfa4732969749cc4077c746/users/c978dac735244028b2057031da3e81dc/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.537908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059489ff-1048-4c03-8d71-a63acb9c10b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb2007b6bfa4732969749cc4077c746, user_id=c978dac735244028b2057031da3e81dc, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:37.545885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059489ff-1048-4c03-8d71-a63acb9c10b9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:37.558577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1038/2080] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:37 2022] PUT /identity/v3/projects/7fb2007b6bfa4732969749cc4077c746/users/c978dac735244028b2057031da3e81dc/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:37.562756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab543d7-641a-43a6-99ad-33339a199149 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:37.576756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab543d7-641a-43a6-99ad-33339a199149 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:37.651918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f110931-bd8a-4d49-873a-1fbb6bba7612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:37.652648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f110931-bd8a-4d49-873a-1fbb6bba7612 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.652932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f110931-bd8a-4d49-873a-1fbb6bba7612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.653204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f110931-bd8a-4d49-873a-1fbb6bba7612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.653953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f110931-bd8a-4d49-873a-1fbb6bba7612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:37.655552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f110931-bd8a-4d49-873a-1fbb6bba7612 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:37.667349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1043/2081] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:37.671720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059489ff-1048-4c03-8d71-a63acb9c10b9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:37.683134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059489ff-1048-4c03-8d71-a63acb9c10b9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:37.688836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d4504-77db-4e6b-862a-56dfe01d7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:37.689563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d4504-77db-4e6b-862a-56dfe01d7f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.689977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d4504-77db-4e6b-862a-56dfe01d7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.690272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d4504-77db-4e6b-862a-56dfe01d7f5f admin admin] PATH_INFO: `/v3/projects/7fb2007b6bfa4732969749cc4077c746/users/c978dac735244028b2057031da3e81dc/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.692440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d4504-77db-4e6b-862a-56dfe01d7f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb2007b6bfa4732969749cc4077c746, user_id=c978dac735244028b2057031da3e81dc, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:37.695182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d4504-77db-4e6b-862a-56dfe01d7f5f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:37.707401 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1039/2082] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:37 2022] PUT /identity/v3/projects/7fb2007b6bfa4732969749cc4077c746/users/c978dac735244028b2057031da3e81dc/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:37.718926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354fbdf-8d75-48fe-b36b-9df4273e94eb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.719217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354fbdf-8d75-48fe-b36b-9df4273e94eb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.719538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354fbdf-8d75-48fe-b36b-9df4273e94eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.749918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d354fbdf-8d75-48fe-b36b-9df4273e94eb None None] MFA Rules not processed for user `c978dac735244028b2057031da3e81dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:37.751218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d354fbdf-8d75-48fe-b36b-9df4273e94eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:37.825560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1044/2083] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:37.838486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d4504-77db-4e6b-862a-56dfe01d7f5f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:37.840386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-245d4504-77db-4e6b-862a-56dfe01d7f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:37.899399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d4504-77db-4e6b-862a-56dfe01d7f5f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:37.903536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65cb33-ba62-4666-867e-0caccac86c32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:37.904165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65cb33-ba62-4666-867e-0caccac86c32 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:37.904500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65cb33-ba62-4666-867e-0caccac86c32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:37.904722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65cb33-ba62-4666-867e-0caccac86c32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:37.915565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65cb33-ba62-4666-867e-0caccac86c32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:37.917044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65cb33-ba62-4666-867e-0caccac86c32 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:37.931840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1040/2084] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:37.968200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354fbdf-8d75-48fe-b36b-9df4273e94eb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:37.977408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:38.034432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354fbdf-8d75-48fe-b36b-9df4273e94eb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:38.040305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:38.040977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:38.041283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:38.041598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] PATH_INFO: `/v3/users/69a5457789b74ffe90d6ca7e452ed2da` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:38.042895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a5457789b74ffe90d6ca7e452ed2da)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:38.044870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:38.096289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a5457789b74ffe90d6ca7e452ed2da'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.096953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a5457789b74ffe90d6ca7e452ed2da'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.097807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a5457789b74ffe90d6ca7e452ed2da'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.111664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a5457789b74ffe90d6ca7e452ed2da'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.119512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a5457789b74ffe90d6ca7e452ed2da'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.132264 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1045/2085] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:37 2022] DELETE /identity/v3/users/69a5457789b74ffe90d6ca7e452ed2da => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:38.136891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466e11b-61f2-485e-b4d0-617074411514 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:38.137181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466e11b-61f2-485e-b4d0-617074411514 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:38.137488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466e11b-61f2-485e-b4d0-617074411514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:38.158137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5466e11b-61f2-485e-b4d0-617074411514 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:38.159351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5466e11b-61f2-485e-b4d0-617074411514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:38.220184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1041/2086] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:38.230428 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:38.231887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:38.305126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2cc03-b4ef-4f9a-a84f-f8146f866171 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:38.309499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371072f-a89e-414a-b8a3-09728f60be89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:38.310476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371072f-a89e-414a-b8a3-09728f60be89 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:38.310917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371072f-a89e-414a-b8a3-09728f60be89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:38.311337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371072f-a89e-414a-b8a3-09728f60be89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:38.322972 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371072f-a89e-414a-b8a3-09728f60be89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:38.324453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371072f-a89e-414a-b8a3-09728f60be89 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:38.335513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1046/2087] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:38.633557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466e11b-61f2-485e-b4d0-617074411514 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:38.635378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5466e11b-61f2-485e-b4d0-617074411514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:38.650024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466e11b-61f2-485e-b4d0-617074411514 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:38.670705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:38.676620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:38.677204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:38.677204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] PATH_INFO: `/v3/projects/f6c2f4536648450b97709fa77ed4d301` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:38.680629 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c2f4536648450b97709fa77ed4d301)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:38.682611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:38.736986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c2f4536648450b97709fa77ed4d301', 'request_id': 'req-a2738be1-5c85-4f86-be76-a3bf327dd535'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.738914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:38.748948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c2f4536648450b97709fa77ed4d301', 'request_id': 'req-a2738be1-5c85-4f86-be76-a3bf327dd535'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.756583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c2f4536648450b97709fa77ed4d301', 'request_id': 'req-a2738be1-5c85-4f86-be76-a3bf327dd535'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.768583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] The token cache is being invalidate because project f6c2f4536648450b97709fa77ed4d301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:38.768863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.769549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.771109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1042/2088] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:38 2022] DELETE /identity/v3/projects/f6c2f4536648450b97709fa77ed4d301 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:38.775139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371072f-a89e-414a-b8a3-09728f60be89 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:38.786472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371072f-a89e-414a-b8a3-09728f60be89 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:38.828549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:38.867296 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:38.867963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:38.868232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:38.868621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] PATH_INFO: `/v3/users/c978dac735244028b2057031da3e81dc` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:38.870138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c978dac735244028b2057031da3e81dc)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:38.872181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:38.924058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c978dac735244028b2057031da3e81dc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.924776 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c978dac735244028b2057031da3e81dc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.925422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c978dac735244028b2057031da3e81dc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.938600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c978dac735244028b2057031da3e81dc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.946569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0efa73c1-8291-4b34-92f1-f6a7c72f2099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c978dac735244028b2057031da3e81dc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:38.963984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1047/2089] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:38 2022] DELETE /identity/v3/users/c978dac735244028b2057031da3e81dc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:39.329289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:39.331894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:39.345530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2738be1-5c85-4f86-be76-a3bf327dd535 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:39.409607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:39.410420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.410624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.410980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] PATH_INFO: `/v3/projects/7fb2007b6bfa4732969749cc4077c746` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:39.412467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb2007b6bfa4732969749cc4077c746)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:39.414585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:39.470172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb2007b6bfa4732969749cc4077c746', 'request_id': 'req-2abbd91a-783f-4077-bd87-286b9c703117'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:39.478879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb2007b6bfa4732969749cc4077c746', 'request_id': 'req-2abbd91a-783f-4077-bd87-286b9c703117'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:39.485823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb2007b6bfa4732969749cc4077c746', 'request_id': 'req-2abbd91a-783f-4077-bd87-286b9c703117'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:39.502538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] The token cache is being invalidate because project 7fb2007b6bfa4732969749cc4077c746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:39.502833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:39.503569 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2abbd91a-783f-4077-bd87-286b9c703117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:39.505254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1043/2090] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:39 2022] DELETE /identity/v3/projects/7fb2007b6bfa4732969749cc4077c746 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:39.510497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5b6bf-dfbf-44e8-9927-6467fb79afe3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.510782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5b6bf-dfbf-44e8-9927-6467fb79afe3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.511065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5b6bf-dfbf-44e8-9927-6467fb79afe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:39.533664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f0c5b6bf-dfbf-44e8-9927-6467fb79afe3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:39.534931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f0c5b6bf-dfbf-44e8-9927-6467fb79afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:39.597423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1048/2091] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:39.605299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0fe3-fece-4c9f-931b-3a49d93859f6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.605593 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0fe3-fece-4c9f-931b-3a49d93859f6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.605861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0fe3-fece-4c9f-931b-3a49d93859f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:39.627927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-427e0fe3-fece-4c9f-931b-3a49d93859f6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:39.629627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-427e0fe3-fece-4c9f-931b-3a49d93859f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:39.638827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1044/2092] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:39.643548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5b6bf-dfbf-44e8-9927-6467fb79afe3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:39.654478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5b6bf-dfbf-44e8-9927-6467fb79afe3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:39.659420 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445d3d-23de-418a-8122-14f6f5421867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:39.660043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445d3d-23de-418a-8122-14f6f5421867 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.660318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445d3d-23de-418a-8122-14f6f5421867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.660584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445d3d-23de-418a-8122-14f6f5421867 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:39.661290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445d3d-23de-418a-8122-14f6f5421867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:39.661609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445d3d-23de-418a-8122-14f6f5421867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:39.663203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445d3d-23de-418a-8122-14f6f5421867 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:39.676078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1049/2093] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:39.680484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0fe3-fece-4c9f-931b-3a49d93859f6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:39.691060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0fe3-fece-4c9f-931b-3a49d93859f6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:39.697163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc787e-ae20-4dd9-89a5-6bbeac076f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:39.697975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc787e-ae20-4dd9-89a5-6bbeac076f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.698258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc787e-ae20-4dd9-89a5-6bbeac076f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.698530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc787e-ae20-4dd9-89a5-6bbeac076f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:39.699232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc787e-ae20-4dd9-89a5-6bbeac076f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:39.701573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc787e-ae20-4dd9-89a5-6bbeac076f92 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:39.735208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1045/2094] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:39 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:39.739516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445d3d-23de-418a-8122-14f6f5421867 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:39.750334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445d3d-23de-418a-8122-14f6f5421867 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:39.784439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:39.812855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff9c30-9c20-4ce7-bfaa-6abe4085aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:39.813876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9c30-9c20-4ce7-bfaa-6abe4085aa41 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.814162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9c30-9c20-4ce7-bfaa-6abe4085aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.814585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9c30-9c20-4ce7-bfaa-6abe4085aa41 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:39.815346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff9c30-9c20-4ce7-bfaa-6abe4085aa41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:39.817465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff9c30-9c20-4ce7-bfaa-6abe4085aa41 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:39.841293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1050/2095] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:39 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:39.845684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc787e-ae20-4dd9-89a5-6bbeac076f92 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:39.860826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc787e-ae20-4dd9-89a5-6bbeac076f92 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:39.865988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dff5d-54ae-4b74-9510-02cb7e60dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:39.866602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dff5d-54ae-4b74-9510-02cb7e60dd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.866913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dff5d-54ae-4b74-9510-02cb7e60dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.867156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dff5d-54ae-4b74-9510-02cb7e60dd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:39.867875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dff5d-54ae-4b74-9510-02cb7e60dd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:39.869471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dff5d-54ae-4b74-9510-02cb7e60dd30 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:39.879746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1046/2096] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:39.883698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff9c30-9c20-4ce7-bfaa-6abe4085aa41 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:39.894615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff9c30-9c20-4ce7-bfaa-6abe4085aa41 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:39.900157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45555af0-57f0-428c-a40d-ba8d8092a25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:39.900794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45555af0-57f0-428c-a40d-ba8d8092a25d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.901076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45555af0-57f0-428c-a40d-ba8d8092a25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.901389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45555af0-57f0-428c-a40d-ba8d8092a25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:39.902300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45555af0-57f0-428c-a40d-ba8d8092a25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:39.903725 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45555af0-57f0-428c-a40d-ba8d8092a25d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:39.915886 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1051/2097] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:39.920246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dff5d-54ae-4b74-9510-02cb7e60dd30 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:39.931134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dff5d-54ae-4b74-9510-02cb7e60dd30 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:39.935994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf97dc5-194d-40b4-9125-37877645e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:39.936759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf97dc5-194d-40b4-9125-37877645e948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.937089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf97dc5-194d-40b4-9125-37877645e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.937465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf97dc5-194d-40b4-9125-37877645e948 admin admin] PATH_INFO: `/v3/projects/adb2d5effa734a378fb497e2c1cceac8/users/e42b0e24fd014346a4eb98fa0ddf13b3/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:39.955952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf97dc5-194d-40b4-9125-37877645e948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb2d5effa734a378fb497e2c1cceac8, user_id=e42b0e24fd014346a4eb98fa0ddf13b3, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:39.959761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf97dc5-194d-40b4-9125-37877645e948 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:39.975076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1047/2098] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:39 2022] PUT /identity/v3/projects/adb2d5effa734a378fb497e2c1cceac8/users/e42b0e24fd014346a4eb98fa0ddf13b3/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:39.986800 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c971ab-c494-4dad-bf53-51ac99c69d10 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:39.987087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c971ab-c494-4dad-bf53-51ac99c69d10 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:39.987575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c971ab-c494-4dad-bf53-51ac99c69d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:40.018023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-26c971ab-c494-4dad-bf53-51ac99c69d10 None None] MFA Rules not processed for user `e42b0e24fd014346a4eb98fa0ddf13b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:40.019526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-26c971ab-c494-4dad-bf53-51ac99c69d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:40.098071 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1052/2099] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:40.109089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf97dc5-194d-40b4-9125-37877645e948 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:40.111183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eaf97dc5-194d-40b4-9125-37877645e948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:40.118655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:40.179458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf97dc5-194d-40b4-9125-37877645e948 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:40.183928 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e1fc0-1952-45b0-8771-29704855c4c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:40.184589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e1fc0-1952-45b0-8771-29704855c4c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:40.184901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e1fc0-1952-45b0-8771-29704855c4c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:40.185169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e1fc0-1952-45b0-8771-29704855c4c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:40.197223 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e1fc0-1952-45b0-8771-29704855c4c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:40.200199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e1fc0-1952-45b0-8771-29704855c4c0 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:40.212542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1048/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:48.038647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c971ab-c494-4dad-bf53-51ac99c69d10 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:48.188582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c971ab-c494-4dad-bf53-51ac99c69d10 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:48.203198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:48.204607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:48.206733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:48.207237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] PATH_INFO: `/v3/users/e42b0e24fd014346a4eb98fa0ddf13b3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:48.210504 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42b0e24fd014346a4eb98fa0ddf13b3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:48.213291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:48.276582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:48.278654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42b0e24fd014346a4eb98fa0ddf13b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:48.279482 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42b0e24fd014346a4eb98fa0ddf13b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:48.280158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42b0e24fd014346a4eb98fa0ddf13b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:48.295345 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42b0e24fd014346a4eb98fa0ddf13b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:48.312570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42b0e24fd014346a4eb98fa0ddf13b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:48.330300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1053/2101] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:48 2022] DELETE /identity/v3/users/e42b0e24fd014346a4eb98fa0ddf13b3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:48.335564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d42675-d451-4098-a690-5b4ece08a286 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:48.336587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d42675-d451-4098-a690-5b4ece08a286 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:48.337846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d42675-d451-4098-a690-5b4ece08a286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:48.359245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-55d42675-d451-4098-a690-5b4ece08a286 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:48.360887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-55d42675-d451-4098-a690-5b4ece08a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:48.438592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1049/2102] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:48.448636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:48.450278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:48.520807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe9dd-bd34-482d-8332-7f06f2a863ce admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:48.524728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313255c-06d2-4d36-9690-449bcaf8ba61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:48.525540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313255c-06d2-4d36-9690-449bcaf8ba61 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:48.525985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313255c-06d2-4d36-9690-449bcaf8ba61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:48.526248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313255c-06d2-4d36-9690-449bcaf8ba61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:48.538021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313255c-06d2-4d36-9690-449bcaf8ba61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:48.539594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313255c-06d2-4d36-9690-449bcaf8ba61 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:48.550149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1054/2103] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:48.928927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d42675-d451-4098-a690-5b4ece08a286 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:48.930436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-55d42675-d451-4098-a690-5b4ece08a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:48.949864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d42675-d451-4098-a690-5b4ece08a286 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:48.964862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:48.965842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:48.966319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:48.966660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] PATH_INFO: `/v3/projects/adb2d5effa734a378fb497e2c1cceac8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:48.968405 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb2d5effa734a378fb497e2c1cceac8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:48.971835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:49.031781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb2d5effa734a378fb497e2c1cceac8', 'request_id': 'req-969542b5-15d2-42eb-8248-70e0400a0349'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:49.039892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb2d5effa734a378fb497e2c1cceac8', 'request_id': 'req-969542b5-15d2-42eb-8248-70e0400a0349'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:49.046915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb2d5effa734a378fb497e2c1cceac8', 'request_id': 'req-969542b5-15d2-42eb-8248-70e0400a0349'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:49.060670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] The token cache is being invalidate because project adb2d5effa734a378fb497e2c1cceac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:49.061056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:49.061796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-969542b5-15d2-42eb-8248-70e0400a0349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:49.063542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1050/2104] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:48 2022] DELETE /identity/v3/projects/adb2d5effa734a378fb497e2c1cceac8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:49.069056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d439-51fe-472a-ad81-085bcbd1d6f4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.069749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d439-51fe-472a-ad81-085bcbd1d6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.069749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d439-51fe-472a-ad81-085bcbd1d6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.092986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d746d439-51fe-472a-ad81-085bcbd1d6f4 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:49.094274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d746d439-51fe-472a-ad81-085bcbd1d6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:49.188252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ecfa2-d53c-48df-843e-96d9e215da13 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.188559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ecfa2-d53c-48df-843e-96d9e215da13 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.188838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ecfa2-d53c-48df-843e-96d9e215da13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.197722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1055/2105] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:49.225328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9a6ecfa2-d53c-48df-843e-96d9e215da13 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:49.226579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9a6ecfa2-d53c-48df-843e-96d9e215da13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:49.237549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cafeca-6548-4389-9624-2def801bcc60 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.238664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cafeca-6548-4389-9624-2def801bcc60 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.238664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cafeca-6548-4389-9624-2def801bcc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.242987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1051/2106] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:49.248100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ecfa2-d53c-48df-843e-96d9e215da13 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:49.264367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ecfa2-d53c-48df-843e-96d9e215da13 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:49.265397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-92cafeca-6548-4389-9624-2def801bcc60 None None] MFA Rules not processed for user `6bc826246d4d4c2f8c837d1fe0d3f13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:49.268520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-92cafeca-6548-4389-9624-2def801bcc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:49.270058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de32af3-985e-447a-bdac-51a0bc773ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:49.271010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de32af3-985e-447a-bdac-51a0bc773ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.271268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de32af3-985e-447a-bdac-51a0bc773ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.271538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de32af3-985e-447a-bdac-51a0bc773ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.272686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de32af3-985e-447a-bdac-51a0bc773ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:49.272898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de32af3-985e-447a-bdac-51a0bc773ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:49.274769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de32af3-985e-447a-bdac-51a0bc773ee1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:49.292354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1052/2107] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:29:49.296651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de32af3-985e-447a-bdac-51a0bc773ee1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:49.310508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de32af3-985e-447a-bdac-51a0bc773ee1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:49.317417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204c03a-35da-478e-8803-440c5bfe65a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:49.318375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204c03a-35da-478e-8803-440c5bfe65a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.319210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204c03a-35da-478e-8803-440c5bfe65a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.319635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204c03a-35da-478e-8803-440c5bfe65a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.321107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204c03a-35da-478e-8803-440c5bfe65a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:49.335349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204c03a-35da-478e-8803-440c5bfe65a1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:49.358948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:49.365397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1056/2108] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:49.390704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1053/2109] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:49 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:49.394927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cafeca-6548-4389-9624-2def801bcc60 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:49.406788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cafeca-6548-4389-9624-2def801bcc60 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:49.434587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:49.527490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e512-5b99-4837-9a95-616eb6c37a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:49.528178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e512-5b99-4837-9a95-616eb6c37a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.528490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e512-5b99-4837-9a95-616eb6c37a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.528725 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e512-5b99-4837-9a95-616eb6c37a54 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.530147 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55e512-5b99-4837-9a95-616eb6c37a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:49.532313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55e512-5b99-4837-9a95-616eb6c37a54 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:49.557089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1057/2110] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:49 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:49.561030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204c03a-35da-478e-8803-440c5bfe65a1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:49.572555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204c03a-35da-478e-8803-440c5bfe65a1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:49.580144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba20ab4-b6a8-4835-9336-373f91ba0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:49.581078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20ab4-b6a8-4835-9336-373f91ba0b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.581725 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20ab4-b6a8-4835-9336-373f91ba0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.582041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20ab4-b6a8-4835-9336-373f91ba0b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.582943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba20ab4-b6a8-4835-9336-373f91ba0b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:49.584817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba20ab4-b6a8-4835-9336-373f91ba0b49 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:49.596741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1054/2111] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:49.601005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e512-5b99-4837-9a95-616eb6c37a54 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:49.612674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e512-5b99-4837-9a95-616eb6c37a54 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:49.617851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421a785-306f-4ac2-bbe4-6ce92cec341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:49.618477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421a785-306f-4ac2-bbe4-6ce92cec341a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.618751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421a785-306f-4ac2-bbe4-6ce92cec341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.619019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421a785-306f-4ac2-bbe4-6ce92cec341a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.619724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421a785-306f-4ac2-bbe4-6ce92cec341a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:49.621344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421a785-306f-4ac2-bbe4-6ce92cec341a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:49.636281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba20ab4-b6a8-4835-9336-373f91ba0b49 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:49.638396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1058/2112] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:49.648813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba20ab4-b6a8-4835-9336-373f91ba0b49 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:49.653868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdc98-413a-47ad-bbe7-566196d2a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:49.654549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdc98-413a-47ad-bbe7-566196d2a195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.654823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdc98-413a-47ad-bbe7-566196d2a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.655242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdc98-413a-47ad-bbe7-566196d2a195 admin admin] PATH_INFO: `/v3/projects/6c5d32d01e874564ac5a75295e43f9c9/users/be61ab24e644497b8f01251c2cf16823/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.674179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cdc98-413a-47ad-bbe7-566196d2a195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5d32d01e874564ac5a75295e43f9c9, user_id=be61ab24e644497b8f01251c2cf16823, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:49.677491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cdc98-413a-47ad-bbe7-566196d2a195 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:49.695736 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1055/2113] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:49 2022] PUT /identity/v3/projects/6c5d32d01e874564ac5a75295e43f9c9/users/be61ab24e644497b8f01251c2cf16823/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:49.707594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff010bee-f01c-42ae-8b1f-871c7a701f98 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.708044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff010bee-f01c-42ae-8b1f-871c7a701f98 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.708487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff010bee-f01c-42ae-8b1f-871c7a701f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.754356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ff010bee-f01c-42ae-8b1f-871c7a701f98 None None] MFA Rules not processed for user `be61ab24e644497b8f01251c2cf16823`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:49.755848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ff010bee-f01c-42ae-8b1f-871c7a701f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:49.875872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1059/2114] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:49.880338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdc98-413a-47ad-bbe7-566196d2a195 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:49.959886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdc98-413a-47ad-bbe7-566196d2a195 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:49.968795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2291e-65fd-4caf-bdf7-e76955a19e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:49.970532 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2291e-65fd-4caf-bdf7-e76955a19e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:49.971064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2291e-65fd-4caf-bdf7-e76955a19e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:49.972289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2291e-65fd-4caf-bdf7-e76955a19e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:49.973196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2291e-65fd-4caf-bdf7-e76955a19e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:49.976992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2291e-65fd-4caf-bdf7-e76955a19e0e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:50.021031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1056/2115] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:49 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:50.025548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff010bee-f01c-42ae-8b1f-871c7a701f98 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:50.061159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff010bee-f01c-42ae-8b1f-871c7a701f98 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:50.177096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf549c-8ed9-41d9-b057-bc4399993009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:50.178045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf549c-8ed9-41d9-b057-bc4399993009 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:50.178482 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf549c-8ed9-41d9-b057-bc4399993009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:50.179839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf549c-8ed9-41d9-b057-bc4399993009 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:50.181029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf549c-8ed9-41d9-b057-bc4399993009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:50.183431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf549c-8ed9-41d9-b057-bc4399993009 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:50.223519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2291e-65fd-4caf-bdf7-e76955a19e0e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:50.254700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1060/2116] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:50 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:29:50.259777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2291e-65fd-4caf-bdf7-e76955a19e0e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:50.289084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace48e41-eed0-4dc2-bad9-9582647f4b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:50.289765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace48e41-eed0-4dc2-bad9-9582647f4b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:50.290424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace48e41-eed0-4dc2-bad9-9582647f4b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:50.290618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace48e41-eed0-4dc2-bad9-9582647f4b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:50.291825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace48e41-eed0-4dc2-bad9-9582647f4b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:50.292885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace48e41-eed0-4dc2-bad9-9582647f4b62 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:50.305938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1057/2117] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:50.310417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf549c-8ed9-41d9-b057-bc4399993009 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:50.328791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf549c-8ed9-41d9-b057-bc4399993009 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:50.352126 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f9239-32dc-4199-aca2-340ebf2fa3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:50.352872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f9239-32dc-4199-aca2-340ebf2fa3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:50.353157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f9239-32dc-4199-aca2-340ebf2fa3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:50.353459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f9239-32dc-4199-aca2-340ebf2fa3d0 admin admin] PATH_INFO: `/v3/projects/bbaf5c0c9a89462880c8a633183c01e5/users/0d9d100716294e769a49be46a4035851/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:50.370531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:50.408380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f9239-32dc-4199-aca2-340ebf2fa3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbaf5c0c9a89462880c8a633183c01e5, user_id=0d9d100716294e769a49be46a4035851, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:50.413835 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f9239-32dc-4199-aca2-340ebf2fa3d0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:50.448798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1061/2118] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:50 2022] PUT /identity/v3/projects/bbaf5c0c9a89462880c8a633183c01e5/users/0d9d100716294e769a49be46a4035851/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:50.453668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace48e41-eed0-4dc2-bad9-9582647f4b62 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:50.474310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace48e41-eed0-4dc2-bad9-9582647f4b62 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:50.636967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30602f-9eec-47d6-9f15-e858f2ee1f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:50.638158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30602f-9eec-47d6-9f15-e858f2ee1f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:50.639796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30602f-9eec-47d6-9f15-e858f2ee1f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:50.640336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30602f-9eec-47d6-9f15-e858f2ee1f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:50.641862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30602f-9eec-47d6-9f15-e858f2ee1f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:50.648013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30602f-9eec-47d6-9f15-e858f2ee1f7b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:50.670887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f9239-32dc-4199-aca2-340ebf2fa3d0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:50.678802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1058/2119] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:50.687066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f9239-32dc-4199-aca2-340ebf2fa3d0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:50.694002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923a34d-5679-414e-9af8-d1476088f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:50.695345 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923a34d-5679-414e-9af8-d1476088f485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:50.695874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923a34d-5679-414e-9af8-d1476088f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:50.696316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923a34d-5679-414e-9af8-d1476088f485 admin admin] PATH_INFO: `/v3/projects/bbaf5c0c9a89462880c8a633183c01e5/users/0d9d100716294e769a49be46a4035851/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:50.698876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923a34d-5679-414e-9af8-d1476088f485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbaf5c0c9a89462880c8a633183c01e5, user_id=0d9d100716294e769a49be46a4035851, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:50.703839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923a34d-5679-414e-9af8-d1476088f485 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:50.742146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339a7a6-54ae-45dd-b433-534b5c965868 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:50.746487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339a7a6-54ae-45dd-b433-534b5c965868 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:50.749189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339a7a6-54ae-45dd-b433-534b5c965868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:50.765964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1062/2120] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:50 2022] PUT /identity/v3/projects/bbaf5c0c9a89462880c8a633183c01e5/users/0d9d100716294e769a49be46a4035851/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:50.842494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1339a7a6-54ae-45dd-b433-534b5c965868 None None] MFA Rules not processed for user `0d9d100716294e769a49be46a4035851`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:50.843772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1339a7a6-54ae-45dd-b433-534b5c965868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:50.895786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:51.008693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1059/2121] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:51.020897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923a34d-5679-414e-9af8-d1476088f485 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:51.023204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0923a34d-5679-414e-9af8-d1476088f485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:51.105883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923a34d-5679-414e-9af8-d1476088f485 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:51.109945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227e7a4-e73e-4822-8567-6d5db61b11a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:51.110866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227e7a4-e73e-4822-8567-6d5db61b11a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:51.111169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227e7a4-e73e-4822-8567-6d5db61b11a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:51.111466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227e7a4-e73e-4822-8567-6d5db61b11a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:51.218722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227e7a4-e73e-4822-8567-6d5db61b11a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:51.220376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227e7a4-e73e-4822-8567-6d5db61b11a1 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:51.230542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1063/2122] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:51.892307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5894-e897-478b-b810-4e23e5a8008a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:51.892859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5894-e897-478b-b810-4e23e5a8008a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:51.892962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5894-e897-478b-b810-4e23e5a8008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:51.913334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cbcd5894-e897-478b-b810-4e23e5a8008a None None] MFA Rules not processed for user `b9ece518ba544f5190bb914ccb3fe63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:51.914948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cbcd5894-e897-478b-b810-4e23e5a8008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:51.975052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1060/2123] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:54.015741 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227e7a4-e73e-4822-8567-6d5db61b11a1 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:54.171091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227e7a4-e73e-4822-8567-6d5db61b11a1 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:54.177095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:54.177797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:54.178218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:54.178391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] PATH_INFO: `/v3/users/be61ab24e644497b8f01251c2cf16823` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:54.179509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be61ab24e644497b8f01251c2cf16823)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:54.181482 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:54.215946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:54.249617 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be61ab24e644497b8f01251c2cf16823'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:54.250670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be61ab24e644497b8f01251c2cf16823'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:54.251517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be61ab24e644497b8f01251c2cf16823'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:54.264836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be61ab24e644497b8f01251c2cf16823'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:54.275375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be61ab24e644497b8f01251c2cf16823'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:54.292116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1064/2124] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:54 2022] DELETE /identity/v3/users/be61ab24e644497b8f01251c2cf16823 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:54.296770 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573879fe-537f-4e60-b838-7df447ef74f4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:54.297780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573879fe-537f-4e60-b838-7df447ef74f4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:54.298352 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573879fe-537f-4e60-b838-7df447ef74f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:54.334724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-573879fe-537f-4e60-b838-7df447ef74f4 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:54.351808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-573879fe-537f-4e60-b838-7df447ef74f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:54.497316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1061/2125] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:54.507253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:54.509450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:54.581177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddad254-8d94-44cf-b094-35e213efdb63 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:54.584759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc567f1-bc53-4664-a07d-63019430c2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:54.585418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc567f1-bc53-4664-a07d-63019430c2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:54.585694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc567f1-bc53-4664-a07d-63019430c2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:54.585959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc567f1-bc53-4664-a07d-63019430c2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:54.595266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc567f1-bc53-4664-a07d-63019430c2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:54.596709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc567f1-bc53-4664-a07d-63019430c2c6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:54.608215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1065/2126] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:54.958893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573879fe-537f-4e60-b838-7df447ef74f4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:54.960448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-573879fe-537f-4e60-b838-7df447ef74f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:54.985387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573879fe-537f-4e60-b838-7df447ef74f4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:54.993355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:54.994206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:54.994591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:54.995581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] PATH_INFO: `/v3/projects/6c5d32d01e874564ac5a75295e43f9c9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:54.997044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5d32d01e874564ac5a75295e43f9c9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:54.999172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:55.072075 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5d32d01e874564ac5a75295e43f9c9', 'request_id': 'req-0ea0b53c-b330-4564-a8de-8263f6b65cbb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.074412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:55.085342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5d32d01e874564ac5a75295e43f9c9', 'request_id': 'req-0ea0b53c-b330-4564-a8de-8263f6b65cbb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.096196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5d32d01e874564ac5a75295e43f9c9', 'request_id': 'req-0ea0b53c-b330-4564-a8de-8263f6b65cbb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.108672 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] The token cache is being invalidate because project 6c5d32d01e874564ac5a75295e43f9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:55.108866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.110312 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.113351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1062/2127] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:54 2022] DELETE /identity/v3/projects/6c5d32d01e874564ac5a75295e43f9c9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:55.116649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc567f1-bc53-4664-a07d-63019430c2c6 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:55.137056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc567f1-bc53-4664-a07d-63019430c2c6 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:55.178307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:55.180355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:55.237496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:55.238373 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:55.238677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:55.239530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] PATH_INFO: `/v3/users/0d9d100716294e769a49be46a4035851` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:55.240915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9d100716294e769a49be46a4035851)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:55.247015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:55.267357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b53c-b330-4564-a8de-8263f6b65cbb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:55.274011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:55.275327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:55.275969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:55.276227 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] PATH_INFO: `/v3/users/b14495a2b79d417f9ced7aed9f668e87` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:55.277611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14495a2b79d417f9ced7aed9f668e87)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:55.279900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:55.306425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9d100716294e769a49be46a4035851'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.307731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9d100716294e769a49be46a4035851'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.308548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9d100716294e769a49be46a4035851'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.310950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:55.329343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9d100716294e769a49be46a4035851'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.339761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14495a2b79d417f9ced7aed9f668e87'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.344955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84093e1-7482-4b43-83d3-4b7974f89e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9d100716294e769a49be46a4035851'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.349440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14495a2b79d417f9ced7aed9f668e87'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.367285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14495a2b79d417f9ced7aed9f668e87'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.379643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14495a2b79d417f9ced7aed9f668e87'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.381458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14495a2b79d417f9ced7aed9f668e87'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:55.384812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1066/2128] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:55 2022] DELETE /identity/v3/users/0d9d100716294e769a49be46a4035851 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:55.394135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1063/2129] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:29:55 2022] DELETE /identity/v3/users/b14495a2b79d417f9ced7aed9f668e87 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:55.404023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef8f8-fcf2-463c-8961-1f1ddece2952 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:55.410066 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef8f8-fcf2-463c-8961-1f1ddece2952 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:55.410820 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef8f8-fcf2-463c-8961-1f1ddece2952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:55.444003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f77ef8f8-fcf2-463c-8961-1f1ddece2952 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:55.447304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f77ef8f8-fcf2-463c-8961-1f1ddece2952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:55.539350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1067/2130] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:55.557840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:55.560211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:55.650050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dd727-9fb3-4d06-96e0-4f0b8a777e14 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:55.653823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9c5e8-30dc-43e6-9588-0c6ab98767c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:55.654514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9c5e8-30dc-43e6-9588-0c6ab98767c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:55.654784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9c5e8-30dc-43e6-9588-0c6ab98767c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:55.655056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9c5e8-30dc-43e6-9588-0c6ab98767c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:55.668995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9c5e8-30dc-43e6-9588-0c6ab98767c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:55.670480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9c5e8-30dc-43e6-9588-0c6ab98767c3 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:55.676757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:55.683315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1064/2131] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:56.151864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef8f8-fcf2-463c-8961-1f1ddece2952 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:56.155313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f77ef8f8-fcf2-463c-8961-1f1ddece2952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:56.177136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef8f8-fcf2-463c-8961-1f1ddece2952 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:56.188142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:56.189010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.189317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.189657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] PATH_INFO: `/v3/projects/bbaf5c0c9a89462880c8a633183c01e5` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.190955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbaf5c0c9a89462880c8a633183c01e5)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:56.193018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:56.276637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9c5e8-30dc-43e6-9588-0c6ab98767c3 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:56.278136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-48d9c5e8-30dc-43e6-9588-0c6ab98767c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:56.296573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbaf5c0c9a89462880c8a633183c01e5', 'request_id': 'req-ce11f882-48e0-4b7e-8c70-54b439e16b30'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.301805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9c5e8-30dc-43e6-9588-0c6ab98767c3 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:56.320939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbaf5c0c9a89462880c8a633183c01e5', 'request_id': 'req-ce11f882-48e0-4b7e-8c70-54b439e16b30'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.330874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbaf5c0c9a89462880c8a633183c01e5', 'request_id': 'req-ce11f882-48e0-4b7e-8c70-54b439e16b30'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.344534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] The token cache is being invalidate because project bbaf5c0c9a89462880c8a633183c01e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:56.345199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.345928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce11f882-48e0-4b7e-8c70-54b439e16b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.348681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1068/2132] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:56 2022] DELETE /identity/v3/projects/bbaf5c0c9a89462880c8a633183c01e5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:56.353513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398926e-4b21-45e0-9269-0b5eec384669 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.353813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398926e-4b21-45e0-9269-0b5eec384669 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.354089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398926e-4b21-45e0-9269-0b5eec384669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:56.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.385296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] PATH_INFO: `/v3/projects/71d978db57bb4c8d81a6786f469e0a46` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.386583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c398926e-4b21-45e0-9269-0b5eec384669 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:56.401498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c398926e-4b21-45e0-9269-0b5eec384669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:56.402314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d978db57bb4c8d81a6786f469e0a46)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:56.404276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:56.414568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1069/2133] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:56.422341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbfe95-5b98-4e0a-9ddb-509cd4befd6b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.422623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbfe95-5b98-4e0a-9ddb-509cd4befd6b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.422905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbfe95-5b98-4e0a-9ddb-509cd4befd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.444717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-01dbfe95-5b98-4e0a-9ddb-509cd4befd6b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:56.445956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-01dbfe95-5b98-4e0a-9ddb-509cd4befd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:56.455485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1070/2134] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:56.473033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbfe95-5b98-4e0a-9ddb-509cd4befd6b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:56.476270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d978db57bb4c8d81a6786f469e0a46', 'request_id': 'req-dd5b8fa2-c52c-4466-861d-896671636a13'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.482666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbfe95-5b98-4e0a-9ddb-509cd4befd6b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:56.485071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d978db57bb4c8d81a6786f469e0a46', 'request_id': 'req-dd5b8fa2-c52c-4466-861d-896671636a13'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.491291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d978db57bb4c8d81a6786f469e0a46', 'request_id': 'req-dd5b8fa2-c52c-4466-861d-896671636a13'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.503050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] The token cache is being invalidate because project 71d978db57bb4c8d81a6786f469e0a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:29:56.503422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.504245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dd5b8fa2-c52c-4466-861d-896671636a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:29:56.506241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1065/2135] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:29:56 2022] DELETE /identity/v3/projects/71d978db57bb4c8d81a6786f469e0a46 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:29:56.511882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0564b-9714-4647-8d6f-104c1a2ed385 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.512260 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0564b-9714-4647-8d6f-104c1a2ed385 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.512654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0564b-9714-4647-8d6f-104c1a2ed385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.531927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:56.534585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4ac0564b-9714-4647-8d6f-104c1a2ed385 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:56.536583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ac0564b-9714-4647-8d6f-104c1a2ed385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:56.567957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:56.569632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.569632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.569632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.570317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:56.570561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:56.572259 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:56.588505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1071/2136] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:56.592079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:56.597113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:56.612383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1eb1f-d79b-4194-8bb7-4cd651096c16 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:56.618425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341402-8d09-44e4-9cb6-c962564637d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:56.619057 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341402-8d09-44e4-9cb6-c962564637d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.619348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341402-8d09-44e4-9cb6-c962564637d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.619614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341402-8d09-44e4-9cb6-c962564637d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.620291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5341402-8d09-44e4-9cb6-c962564637d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:56.622299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5341402-8d09-44e4-9cb6-c962564637d0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:56.626133 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1066/2137] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:56.634431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4e32f-c724-4651-88ab-dca24354538f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.635244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4e32f-c724-4651-88ab-dca24354538f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.635620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4e32f-c724-4651-88ab-dca24354538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.659554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-65a4e32f-c724-4651-88ab-dca24354538f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:56.661186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-65a4e32f-c724-4651-88ab-dca24354538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:56.662282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1072/2138] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:56 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:56.666682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341402-8d09-44e4-9cb6-c962564637d0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:56.716570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:56.771945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1067/2139] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:56.775924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341402-8d09-44e4-9cb6-c962564637d0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:56.778193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4e32f-c724-4651-88ab-dca24354538f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:56.791410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a83c1f-a135-46bd-b5cd-b9ff459be99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:56.796449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a83c1f-a135-46bd-b5cd-b9ff459be99c admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.796449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a83c1f-a135-46bd-b5cd-b9ff459be99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.796449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a83c1f-a135-46bd-b5cd-b9ff459be99c admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.796449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a83c1f-a135-46bd-b5cd-b9ff459be99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:56.798182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a83c1f-a135-46bd-b5cd-b9ff459be99c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:56.805307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4e32f-c724-4651-88ab-dca24354538f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:56.817650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5872f-0e76-42eb-b5f6-5791aed2f454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:56.819652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5872f-0e76-42eb-b5f6-5791aed2f454 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.819989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5872f-0e76-42eb-b5f6-5791aed2f454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.820273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5872f-0e76-42eb-b5f6-5791aed2f454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.830111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1073/2140] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:56 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:56.830323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5872f-0e76-42eb-b5f6-5791aed2f454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:29:56.830323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5872f-0e76-42eb-b5f6-5791aed2f454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:56.830323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5872f-0e76-42eb-b5f6-5791aed2f454 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:56.832309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a83c1f-a135-46bd-b5cd-b9ff459be99c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:56.852125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a83c1f-a135-46bd-b5cd-b9ff459be99c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:56.866669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1068/2141] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:29:56.871350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5872f-0e76-42eb-b5f6-5791aed2f454 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:56.882673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5872f-0e76-42eb-b5f6-5791aed2f454 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:56.887500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d3a9e-f1f0-410e-a8f5-04347be24cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:56.888153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3a9e-f1f0-410e-a8f5-04347be24cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.888337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a94df-6db4-4d32-b859-471a011b3227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:56.888458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3a9e-f1f0-410e-a8f5-04347be24cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.888691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3a9e-f1f0-410e-a8f5-04347be24cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.889415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d3a9e-f1f0-410e-a8f5-04347be24cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:56.890695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a94df-6db4-4d32-b859-471a011b3227 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:56.891137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a94df-6db4-4d32-b859-471a011b3227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:56.892148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d3a9e-f1f0-410e-a8f5-04347be24cb0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:56.892815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a94df-6db4-4d32-b859-471a011b3227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:56.894040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a94df-6db4-4d32-b859-471a011b3227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:56.897509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a94df-6db4-4d32-b859-471a011b3227 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:56.914342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1074/2142] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:56.915724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a94df-6db4-4d32-b859-471a011b3227 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:56.931991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1069/2143] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:29:56 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:56.932239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a94df-6db4-4d32-b859-471a011b3227 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:56.934893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d3a9e-f1f0-410e-a8f5-04347be24cb0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:57.027284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d3a9e-f1f0-410e-a8f5-04347be24cb0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:57.034655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c57a0e-034e-4fa5-97bc-dda523771bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:57.035718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57a0e-034e-4fa5-97bc-dda523771bba admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.036103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57a0e-034e-4fa5-97bc-dda523771bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.036483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57a0e-034e-4fa5-97bc-dda523771bba admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.039002 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c57a0e-034e-4fa5-97bc-dda523771bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:57.040821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941df7-d65a-446e-82f3-75fcd4cbeaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:57.041746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941df7-d65a-446e-82f3-75fcd4cbeaaf admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.042501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c57a0e-034e-4fa5-97bc-dda523771bba admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:57.042913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941df7-d65a-446e-82f3-75fcd4cbeaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.043357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941df7-d65a-446e-82f3-75fcd4cbeaaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.044407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d941df7-d65a-446e-82f3-75fcd4cbeaaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:57.046495 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d941df7-d65a-446e-82f3-75fcd4cbeaaf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:57.065966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1075/2144] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:29:57.067444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941df7-d65a-446e-82f3-75fcd4cbeaaf admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:57.098094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941df7-d65a-446e-82f3-75fcd4cbeaaf admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:57.111123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1070/2145] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:29:56 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:29:57.115470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c57a0e-034e-4fa5-97bc-dda523771bba admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:57.116076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf039c58-634b-433d-8abf-e9ac7e399710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:57.116949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf039c58-634b-433d-8abf-e9ac7e399710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.117772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf039c58-634b-433d-8abf-e9ac7e399710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.118150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf039c58-634b-433d-8abf-e9ac7e399710 admin admin] PATH_INFO: `/v3/projects/77611da3202f4ab18966d4a9f3f00090/users/4d09b79ca62b4061a379232eff4aad49/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.127607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c57a0e-034e-4fa5-97bc-dda523771bba admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:57.133737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63ab9d-cf5c-4ce7-a3ec-52c941ad51aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:57.134626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63ab9d-cf5c-4ce7-a3ec-52c941ad51aa admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.134917 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63ab9d-cf5c-4ce7-a3ec-52c941ad51aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.135193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63ab9d-cf5c-4ce7-a3ec-52c941ad51aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.136347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63ab9d-cf5c-4ce7-a3ec-52c941ad51aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:57.138271 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63ab9d-cf5c-4ce7-a3ec-52c941ad51aa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:57.139258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf039c58-634b-433d-8abf-e9ac7e399710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77611da3202f4ab18966d4a9f3f00090, user_id=4d09b79ca62b4061a379232eff4aad49, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:57.143184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf039c58-634b-433d-8abf-e9ac7e399710 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:57.151595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1071/2146] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:57.157695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63ab9d-cf5c-4ce7-a3ec-52c941ad51aa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:57.160901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:57.167650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1076/2147] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:57 2022] PUT /identity/v3/projects/77611da3202f4ab18966d4a9f3f00090/users/4d09b79ca62b4061a379232eff4aad49/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:57.174658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63ab9d-cf5c-4ce7-a3ec-52c941ad51aa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:57.174868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afa1c1-6495-4a7b-83df-d5da733eee6c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.175137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afa1c1-6495-4a7b-83df-d5da733eee6c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.175415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afa1c1-6495-4a7b-83df-d5da733eee6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.206988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-85afa1c1-6495-4a7b-83df-d5da733eee6c None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:57.208560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-85afa1c1-6495-4a7b-83df-d5da733eee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:57.247422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816948a-4bed-4f2c-8352-423f0a5f2217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:57.248225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816948a-4bed-4f2c-8352-423f0a5f2217 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.248615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816948a-4bed-4f2c-8352-423f0a5f2217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.249136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816948a-4bed-4f2c-8352-423f0a5f2217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.249985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816948a-4bed-4f2c-8352-423f0a5f2217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:57.251978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816948a-4bed-4f2c-8352-423f0a5f2217 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:57.268692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1072/2148] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:29:57.270493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816948a-4bed-4f2c-8352-423f0a5f2217 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:57.305173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1077/2149] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:57.315372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816948a-4bed-4f2c-8352-423f0a5f2217 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:57.315568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afa1c1-6495-4a7b-83df-d5da733eee6c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:57.317922 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-85afa1c1-6495-4a7b-83df-d5da733eee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:57.325431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aab6ca-b80b-4581-a852-a147dcfd2d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:57.327189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab6ca-b80b-4581-a852-a147dcfd2d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.329633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab6ca-b80b-4581-a852-a147dcfd2d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.331240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab6ca-b80b-4581-a852-a147dcfd2d35 admin admin] PATH_INFO: `/v3/projects/2083e3eb6dc74f85b9576cec99268fb8/users/bc4c5a85d2154983a8f05f78b46d1c6e/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.345606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:57.356953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aab6ca-b80b-4581-a852-a147dcfd2d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2083e3eb6dc74f85b9576cec99268fb8, user_id=bc4c5a85d2154983a8f05f78b46d1c6e, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:57.359906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aab6ca-b80b-4581-a852-a147dcfd2d35 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:57.385354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1073/2150] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:29:57 2022] PUT /identity/v3/projects/2083e3eb6dc74f85b9576cec99268fb8/users/bc4c5a85d2154983a8f05f78b46d1c6e/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:29:57.391059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06c22-3e55-4ff7-9bc8-88e140a41084 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.391864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06c22-3e55-4ff7-9bc8-88e140a41084 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.392327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06c22-3e55-4ff7-9bc8-88e140a41084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.397625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afa1c1-6495-4a7b-83df-d5da733eee6c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:57.426450 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4ba06c22-3e55-4ff7-9bc8-88e140a41084 None None] MFA Rules not processed for user `bc4c5a85d2154983a8f05f78b46d1c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:57.427900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ba06c22-3e55-4ff7-9bc8-88e140a41084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:57.466838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f084-2849-4c38-9a6c-b3f09268ec74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:57.468016 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f084-2849-4c38-9a6c-b3f09268ec74 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.468493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f084-2849-4c38-9a6c-b3f09268ec74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.468990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f084-2849-4c38-9a6c-b3f09268ec74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.519774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1074/2151] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:29:57.532980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06c22-3e55-4ff7-9bc8-88e140a41084 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:57.535182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ba06c22-3e55-4ff7-9bc8-88e140a41084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:57.565615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1f084-2849-4c38-9a6c-b3f09268ec74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:57.568619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1f084-2849-4c38-9a6c-b3f09268ec74 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:57.587064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1078/2152] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:29:57.650644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06c22-3e55-4ff7-9bc8-88e140a41084 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:57.657574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed249316-a464-4e53-981c-f218f4b24cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:57.658475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed249316-a464-4e53-981c-f218f4b24cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:57.658997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed249316-a464-4e53-981c-f218f4b24cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:57.659431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed249316-a464-4e53-981c-f218f4b24cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:57.681062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed249316-a464-4e53-981c-f218f4b24cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:57.683400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed249316-a464-4e53-981c-f218f4b24cc2 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:57.698329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1075/2153] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:29:58.935313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd1c2c-8dc7-4df2-9bc5-48112a3c2495 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:58.935853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd1c2c-8dc7-4df2-9bc5-48112a3c2495 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:58.935853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd1c2c-8dc7-4df2-9bc5-48112a3c2495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:58.952729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:29:58.974349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5fdd1c2c-8dc7-4df2-9bc5-48112a3c2495 None None] MFA Rules not processed for user `4d09b79ca62b4061a379232eff4aad49`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:29:58.975781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5fdd1c2c-8dc7-4df2-9bc5-48112a3c2495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:59.069322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1079/2154] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:29:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:29:59.082442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed249316-a464-4e53-981c-f218f4b24cc2 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:29:59.083914 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ed249316-a464-4e53-981c-f218f4b24cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:29:59.097293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed249316-a464-4e53-981c-f218f4b24cc2 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:29:59.101181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95cdbc-870e-4566-bdbe-8c4ef85f25a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:29:59.101868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95cdbc-870e-4566-bdbe-8c4ef85f25a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:29:59.102145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95cdbc-870e-4566-bdbe-8c4ef85f25a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:29:59.102415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95cdbc-870e-4566-bdbe-8c4ef85f25a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:29:59.111616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95cdbc-870e-4566-bdbe-8c4ef85f25a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:29:59.113049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95cdbc-870e-4566-bdbe-8c4ef85f25a7 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:29:59.123482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1076/2155] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:29:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:30:00.603695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd1c2c-8dc7-4df2-9bc5-48112a3c2495 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:00.612201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfed72-db4e-4da1-8788-f137ce92c41f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:00.612788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfed72-db4e-4da1-8788-f137ce92c41f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:00.612788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfed72-db4e-4da1-8788-f137ce92c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:00.617608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd1c2c-8dc7-4df2-9bc5-48112a3c2495 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:00.622359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:00.623082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:00.623377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:00.623645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] PATH_INFO: `/v3/users/bc4c5a85d2154983a8f05f78b46d1c6e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:00.625282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4c5a85d2154983a8f05f78b46d1c6e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:00.628290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:00.660172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5dcfed72-db4e-4da1-8788-f137ce92c41f None None] MFA Rules not processed for user `4d09b79ca62b4061a379232eff4aad49`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:00.661599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5dcfed72-db4e-4da1-8788-f137ce92c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:00.669755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1077/2156] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:00.704308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4c5a85d2154983a8f05f78b46d1c6e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:00.705666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4c5a85d2154983a8f05f78b46d1c6e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:00.706829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4c5a85d2154983a8f05f78b46d1c6e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:00.737417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4c5a85d2154983a8f05f78b46d1c6e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:00.750288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4c5a85d2154983a8f05f78b46d1c6e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:00.784528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1080/2157] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:30:00 2022] DELETE /identity/v3/users/bc4c5a85d2154983a8f05f78b46d1c6e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:30:00.789142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca1b6d-8085-41d8-8d45-4d3873853d70 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:00.789483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca1b6d-8085-41d8-8d45-4d3873853d70 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:00.789761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca1b6d-8085-41d8-8d45-4d3873853d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:00.818256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-65ca1b6d-8085-41d8-8d45-4d3873853d70 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:00.821570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-65ca1b6d-8085-41d8-8d45-4d3873853d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:00.928471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:00.940592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1078/2158] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:00.952653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:00.956005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:01.036151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94483d5-0ab4-4640-b2f7-3fdffe559c29 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:01.040378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08237b59-4ccb-48b3-a898-9a4d2a950b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:01.041379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08237b59-4ccb-48b3-a898-9a4d2a950b0d service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:01.042013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08237b59-4ccb-48b3-a898-9a4d2a950b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:01.042452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08237b59-4ccb-48b3-a898-9a4d2a950b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:01.054766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08237b59-4ccb-48b3-a898-9a4d2a950b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:01.056299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08237b59-4ccb-48b3-a898-9a4d2a950b0d service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:01.066853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1081/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:30:01.418231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca1b6d-8085-41d8-8d45-4d3873853d70 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:01.419655 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-65ca1b6d-8085-41d8-8d45-4d3873853d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:01.434272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca1b6d-8085-41d8-8d45-4d3873853d70 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:01.440213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:01.441315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:01.441658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:01.442036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] PATH_INFO: `/v3/projects/2083e3eb6dc74f85b9576cec99268fb8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:01.443705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=2083e3eb6dc74f85b9576cec99268fb8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:01.454880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:01.578871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2083e3eb6dc74f85b9576cec99268fb8', 'request_id': 'req-1d3fafd3-5eee-482e-931a-397f600f57ec'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:01.600826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2083e3eb6dc74f85b9576cec99268fb8', 'request_id': 'req-1d3fafd3-5eee-482e-931a-397f600f57ec'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:01.609015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2083e3eb6dc74f85b9576cec99268fb8', 'request_id': 'req-1d3fafd3-5eee-482e-931a-397f600f57ec'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:01.628382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] The token cache is being invalidate because project 2083e3eb6dc74f85b9576cec99268fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:30:01.629033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:01.629405 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:01.635422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1079/2160] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:30:01 2022] DELETE /identity/v3/projects/2083e3eb6dc74f85b9576cec99268fb8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:30:08.517978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10310325-fe96-4fc4-8210-36500f2eda74 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:08.518533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10310325-fe96-4fc4-8210-36500f2eda74 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:08.518533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10310325-fe96-4fc4-8210-36500f2eda74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:08.538519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-10310325-fe96-4fc4-8210-36500f2eda74 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:08.539799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-10310325-fe96-4fc4-8210-36500f2eda74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:08.546183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:08.602601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1082/2161] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:30:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:08.661789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:08.664198 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:08.766366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fafd3-5eee-482e-931a-397f600f57ec admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:08.783055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c80aaa-0cdc-497f-ac35-a866887db0b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:08.784142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80aaa-0cdc-497f-ac35-a866887db0b2 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:08.784482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80aaa-0cdc-497f-ac35-a866887db0b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:08.784874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80aaa-0cdc-497f-ac35-a866887db0b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:08.796044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c80aaa-0cdc-497f-ac35-a866887db0b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:08.798283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c80aaa-0cdc-497f-ac35-a866887db0b2 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:08.809703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1080/2162] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:30:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:30:14.033122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10310325-fe96-4fc4-8210-36500f2eda74 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:14.038150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-10310325-fe96-4fc4-8210-36500f2eda74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:14.187555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10310325-fe96-4fc4-8210-36500f2eda74 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:14.210785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:14.212198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:14.212574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:14.212949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] PATH_INFO: `/v3/users/0ce7a111fd6f4943a5f14ccfc18127f2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:14.214425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce7a111fd6f4943a5f14ccfc18127f2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:14.216471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:14.328520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce7a111fd6f4943a5f14ccfc18127f2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:14.330624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce7a111fd6f4943a5f14ccfc18127f2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:14.331539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce7a111fd6f4943a5f14ccfc18127f2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:14.367112 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce7a111fd6f4943a5f14ccfc18127f2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:14.376939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce7a111fd6f4943a5f14ccfc18127f2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:14.395511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1083/2163] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:30:14 2022] DELETE /identity/v3/users/0ce7a111fd6f4943a5f14ccfc18127f2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:30:14.400149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3528ba8-86f9-4867-b829-6cf95842bee7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:14.400656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3528ba8-86f9-4867-b829-6cf95842bee7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:14.400740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3528ba8-86f9-4867-b829-6cf95842bee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:14.421625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b3528ba8-86f9-4867-b829-6cf95842bee7 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:14.425313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3528ba8-86f9-4867-b829-6cf95842bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:14.508989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1081/2164] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:14.519450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:14.520813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:14.565956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:14.599227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a5acd-ee41-4b24-89ea-962e60d8b396 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:14.606739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d221c8-b05a-4413-abcb-ecdb4310b4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:14.607517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d221c8-b05a-4413-abcb-ecdb4310b4df service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:14.607985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d221c8-b05a-4413-abcb-ecdb4310b4df service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:14.608434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d221c8-b05a-4413-abcb-ecdb4310b4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:14.629426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d221c8-b05a-4413-abcb-ecdb4310b4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:14.632054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d221c8-b05a-4413-abcb-ecdb4310b4df service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:14.665342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1084/2165] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:30:15.053362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3528ba8-86f9-4867-b829-6cf95842bee7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:15.054816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3528ba8-86f9-4867-b829-6cf95842bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:15.083250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3528ba8-86f9-4867-b829-6cf95842bee7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:15.089602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:15.090575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.091029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.091464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] PATH_INFO: `/v3/projects/98420cb82ece4a44a842a080c2a601f9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.093413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98420cb82ece4a44a842a080c2a601f9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:15.095583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:15.112116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:15.183487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98420cb82ece4a44a842a080c2a601f9', 'request_id': 'req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:15.194630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98420cb82ece4a44a842a080c2a601f9', 'request_id': 'req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:15.201443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98420cb82ece4a44a842a080c2a601f9', 'request_id': 'req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:15.218744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] The token cache is being invalidate because project 98420cb82ece4a44a842a080c2a601f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:30:15.219394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:15.221130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e99e67ae-6d1e-4811-a18b-e60be8c09d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:30:15.222984 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1082/2166] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:30:15 2022] DELETE /identity/v3/projects/98420cb82ece4a44a842a080c2a601f9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:30:15.228869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5c2c7-0ef0-45b4-81a3-559f2b18f858 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.229465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5c2c7-0ef0-45b4-81a3-559f2b18f858 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.229870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5c2c7-0ef0-45b4-81a3-559f2b18f858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.255636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-afe5c2c7-0ef0-45b4-81a3-559f2b18f858 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:15.257198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-afe5c2c7-0ef0-45b4-81a3-559f2b18f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:15.349386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1085/2167] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:30:15.355006 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49122a-e47e-4075-a60a-853c2e1c59ba None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.355286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49122a-e47e-4075-a60a-853c2e1c59ba None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.355564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49122a-e47e-4075-a60a-853c2e1c59ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.379105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6b49122a-e47e-4075-a60a-853c2e1c59ba None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:15.380625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6b49122a-e47e-4075-a60a-853c2e1c59ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:15.393421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1083/2168] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:15.394619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5c2c7-0ef0-45b4-81a3-559f2b18f858 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:15.412189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5c2c7-0ef0-45b4-81a3-559f2b18f858 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:15.427703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b23f5-fb9b-4c6c-b18d-ea48d18e6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:15.428673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b23f5-fb9b-4c6c-b18d-ea48d18e6953 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.429114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b23f5-fb9b-4c6c-b18d-ea48d18e6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.429572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b23f5-fb9b-4c6c-b18d-ea48d18e6953 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.432804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b23f5-fb9b-4c6c-b18d-ea48d18e6953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:30:15.433600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b23f5-fb9b-4c6c-b18d-ea48d18e6953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:15.439834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b23f5-fb9b-4c6c-b18d-ea48d18e6953 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:15.461334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1086/2169] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:30:15.466638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49122a-e47e-4075-a60a-853c2e1c59ba None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:15.475620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49122a-e47e-4075-a60a-853c2e1c59ba None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:15.480971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a7fa-1f2d-4cff-8aac-e952fe2aec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:15.481667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a7fa-1f2d-4cff-8aac-e952fe2aec4e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.481947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a7fa-1f2d-4cff-8aac-e952fe2aec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.482227 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a7fa-1f2d-4cff-8aac-e952fe2aec4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.482923 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3a7fa-1f2d-4cff-8aac-e952fe2aec4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:15.485012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3a7fa-1f2d-4cff-8aac-e952fe2aec4e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:15.527508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1084/2170] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:30:15 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:30:15.528728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b23f5-fb9b-4c6c-b18d-ea48d18e6953 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:15.542300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b23f5-fb9b-4c6c-b18d-ea48d18e6953 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:15.617870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466c68-15db-453a-b2ff-8e7f0e472dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:15.618803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466c68-15db-453a-b2ff-8e7f0e472dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.619245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466c68-15db-453a-b2ff-8e7f0e472dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.619667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466c68-15db-453a-b2ff-8e7f0e472dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.620656 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c466c68-15db-453a-b2ff-8e7f0e472dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:15.622798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c466c68-15db-453a-b2ff-8e7f0e472dd8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:15.652322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1087/2171] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:30:15 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:30:15.656514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a7fa-1f2d-4cff-8aac-e952fe2aec4e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:15.674263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a7fa-1f2d-4cff-8aac-e952fe2aec4e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:15.682256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b1e83-86a3-4599-b964-7f1dc69b232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:15.682908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b1e83-86a3-4599-b964-7f1dc69b232b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.683192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b1e83-86a3-4599-b964-7f1dc69b232b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.683724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b1e83-86a3-4599-b964-7f1dc69b232b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.684458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b1e83-86a3-4599-b964-7f1dc69b232b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:15.686725 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b1e83-86a3-4599-b964-7f1dc69b232b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:15.700346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1085/2172] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:30:15.704548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466c68-15db-453a-b2ff-8e7f0e472dd8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:15.718385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466c68-15db-453a-b2ff-8e7f0e472dd8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:15.726300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3fdc-fa67-4106-9f1a-a54d33e03667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:15.727188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3fdc-fa67-4106-9f1a-a54d33e03667 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.727617 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3fdc-fa67-4106-9f1a-a54d33e03667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.728030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3fdc-fa67-4106-9f1a-a54d33e03667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.728877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea3fdc-fa67-4106-9f1a-a54d33e03667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:15.731064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea3fdc-fa67-4106-9f1a-a54d33e03667 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:15.748778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1088/2173] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:30:15.752712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b1e83-86a3-4599-b964-7f1dc69b232b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:15.768303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b1e83-86a3-4599-b964-7f1dc69b232b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:15.773988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eaa78-5442-4ae3-84bb-f4159769696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:15.774815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eaa78-5442-4ae3-84bb-f4159769696e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.775103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eaa78-5442-4ae3-84bb-f4159769696e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.775375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eaa78-5442-4ae3-84bb-f4159769696e admin admin] PATH_INFO: `/v3/projects/be1b2c42b8b64062828a333827f1c1e6/users/ff7969a7458e4237b4ba807433ca3c3d/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.797668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eaa78-5442-4ae3-84bb-f4159769696e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1b2c42b8b64062828a333827f1c1e6, user_id=ff7969a7458e4237b4ba807433ca3c3d, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:15.800598 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eaa78-5442-4ae3-84bb-f4159769696e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:15.819574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1086/2174] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:30:15 2022] PUT /identity/v3/projects/be1b2c42b8b64062828a333827f1c1e6/users/ff7969a7458e4237b4ba807433ca3c3d/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:30:15.824868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867b1cf-f625-4d52-9b1a-a10f0fc2b7aa None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:15.825150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867b1cf-f625-4d52-9b1a-a10f0fc2b7aa None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:15.826240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867b1cf-f625-4d52-9b1a-a10f0fc2b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:15.851004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5867b1cf-f625-4d52-9b1a-a10f0fc2b7aa None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:15.852283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5867b1cf-f625-4d52-9b1a-a10f0fc2b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:15.929048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:15.957452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1089/2175] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:15.963960 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eaa78-5442-4ae3-84bb-f4159769696e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:15.966298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-533eaa78-5442-4ae3-84bb-f4159769696e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:16.052041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eaa78-5442-4ae3-84bb-f4159769696e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:16.056728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20bc0b-ee50-4df9-9244-dd0e1419f24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:16.057456 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20bc0b-ee50-4df9-9244-dd0e1419f24f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:16.057767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20bc0b-ee50-4df9-9244-dd0e1419f24f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:16.058010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20bc0b-ee50-4df9-9244-dd0e1419f24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:16.085638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20bc0b-ee50-4df9-9244-dd0e1419f24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:16.087170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20bc0b-ee50-4df9-9244-dd0e1419f24f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:16.100029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1087/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:30:22.871561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c1baa-7751-4b44-99b5-acdc4eee5360 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:22.872704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c1baa-7751-4b44-99b5-acdc4eee5360 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:22.873231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c1baa-7751-4b44-99b5-acdc4eee5360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:22.921969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-060c1baa-7751-4b44-99b5-acdc4eee5360 None None] MFA Rules not processed for user `ff7969a7458e4237b4ba807433ca3c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:22.923434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-060c1baa-7751-4b44-99b5-acdc4eee5360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:23.029240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1090/2177] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:23.034582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20bc0b-ee50-4df9-9244-dd0e1419f24f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:23.045410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20bc0b-ee50-4df9-9244-dd0e1419f24f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:23.050639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818080a-f4a5-4b7a-a45b-67db32810f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:23.051385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818080a-f4a5-4b7a-a45b-67db32810f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:23.051748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818080a-f4a5-4b7a-a45b-67db32810f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:23.052080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818080a-f4a5-4b7a-a45b-67db32810f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:23.052843 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818080a-f4a5-4b7a-a45b-67db32810f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:23.054902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818080a-f4a5-4b7a-a45b-67db32810f51 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:23.087638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1088/2178] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:30:23 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:30:23.098741 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c1baa-7751-4b44-99b5-acdc4eee5360 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:23.113376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c1baa-7751-4b44-99b5-acdc4eee5360 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:23.218071 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04745724-c7ac-4cee-b5b7-7a80583c7b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:23.219112 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04745724-c7ac-4cee-b5b7-7a80583c7b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:23.219477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04745724-c7ac-4cee-b5b7-7a80583c7b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:23.219801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04745724-c7ac-4cee-b5b7-7a80583c7b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:23.220671 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04745724-c7ac-4cee-b5b7-7a80583c7b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:23.222991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04745724-c7ac-4cee-b5b7-7a80583c7b92 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:23.253998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1091/2179] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:30:23 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:30:23.255780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818080a-f4a5-4b7a-a45b-67db32810f51 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:23.272694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818080a-f4a5-4b7a-a45b-67db32810f51 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:23.280348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976672b6-eaac-484a-a172-eca2214155b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:23.281169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976672b6-eaac-484a-a172-eca2214155b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:23.281565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976672b6-eaac-484a-a172-eca2214155b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:23.281920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976672b6-eaac-484a-a172-eca2214155b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:23.282842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976672b6-eaac-484a-a172-eca2214155b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:23.285476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976672b6-eaac-484a-a172-eca2214155b8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:23.299148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1089/2180] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:30:23.303677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04745724-c7ac-4cee-b5b7-7a80583c7b92 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:23.315077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04745724-c7ac-4cee-b5b7-7a80583c7b92 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:23.322115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145529f-59bb-4f1e-b560-afa77bc1eb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:23.322948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145529f-59bb-4f1e-b560-afa77bc1eb55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:23.323329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145529f-59bb-4f1e-b560-afa77bc1eb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:23.323671 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145529f-59bb-4f1e-b560-afa77bc1eb55 admin admin] PATH_INFO: `/v3/projects/3ee663ac013149188c40cc75f216f7c0/users/a3662d1d20f246688748796d04d87101/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:23.350529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef8f3-2e3f-4e4a-978d-2d59805d00bc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:23.350529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef8f3-2e3f-4e4a-978d-2d59805d00bc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:23.350529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef8f3-2e3f-4e4a-978d-2d59805d00bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:23.356283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145529f-59bb-4f1e-b560-afa77bc1eb55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee663ac013149188c40cc75f216f7c0, user_id=a3662d1d20f246688748796d04d87101, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:23.360451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:23.362502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145529f-59bb-4f1e-b560-afa77bc1eb55 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:23.383562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1092/2181] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:30:23 2022] PUT /identity/v3/projects/3ee663ac013149188c40cc75f216f7c0/users/a3662d1d20f246688748796d04d87101/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:30:23.387320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145529f-59bb-4f1e-b560-afa77bc1eb55 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:23.394335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-767ef8f3-2e3f-4e4a-978d-2d59805d00bc None None] MFA Rules not processed for user `4d09b79ca62b4061a379232eff4aad49`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:23.403405 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-767ef8f3-2e3f-4e4a-978d-2d59805d00bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:23.473968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:23.521305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145529f-59bb-4f1e-b560-afa77bc1eb55 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:23.530404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90519a-396a-462b-8cb3-a9e9676e6b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:23.531563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90519a-396a-462b-8cb3-a9e9676e6b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:23.532121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90519a-396a-462b-8cb3-a9e9676e6b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:23.535696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90519a-396a-462b-8cb3-a9e9676e6b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:23.537121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90519a-396a-462b-8cb3-a9e9676e6b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:23.540108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90519a-396a-462b-8cb3-a9e9676e6b26 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:23.541991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1090/2182] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:30:23.555802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1093/2183] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:30:23.560350 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ef8f3-2e3f-4e4a-978d-2d59805d00bc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:23.571328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ef8f3-2e3f-4e4a-978d-2d59805d00bc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:23.576836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37df60c-a136-46da-9a66-992bb3af7859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:23.577596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37df60c-a136-46da-9a66-992bb3af7859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:23.578000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37df60c-a136-46da-9a66-992bb3af7859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:23.578281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37df60c-a136-46da-9a66-992bb3af7859 admin admin] PATH_INFO: `/v3/projects/3ee663ac013149188c40cc75f216f7c0/users/a3662d1d20f246688748796d04d87101/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:23.580423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37df60c-a136-46da-9a66-992bb3af7859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee663ac013149188c40cc75f216f7c0, user_id=a3662d1d20f246688748796d04d87101, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:23.583290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37df60c-a136-46da-9a66-992bb3af7859 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:23.610875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1091/2184] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:30:23 2022] PUT /identity/v3/projects/3ee663ac013149188c40cc75f216f7c0/users/a3662d1d20f246688748796d04d87101/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:30:28.299632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6e70-e08a-4862-827f-26f79e715ca1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:28.301195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6e70-e08a-4862-827f-26f79e715ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:28.301582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6e70-e08a-4862-827f-26f79e715ca1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:28.304787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1094/2185] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:30:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:30:28.314824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70023175-58f8-4830-a079-bbc614cccc12 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:28.315460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70023175-58f8-4830-a079-bbc614cccc12 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:28.315790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70023175-58f8-4830-a079-bbc614cccc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:28.368798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-70023175-58f8-4830-a079-bbc614cccc12 None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:28.370541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-70023175-58f8-4830-a079-bbc614cccc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:28.521778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1092/2186] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:30:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:28.537248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6e70-e08a-4862-827f-26f79e715ca1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:28.539950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dd5a6e70-e08a-4862-827f-26f79e715ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:28.673753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6e70-e08a-4862-827f-26f79e715ca1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:28.678958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092ae49-fec4-457f-bf60-cb8d54bf789c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb8054ea4249d18903b5998fa753d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:28.680491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092ae49-fec4-457f-bf60-cb8d54bf789c service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:28.681014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092ae49-fec4-457f-bf60-cb8d54bf789c service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:28.681504 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092ae49-fec4-457f-bf60-cb8d54bf789c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:28.715539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092ae49-fec4-457f-bf60-cb8d54bf789c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:28.722282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092ae49-fec4-457f-bf60-cb8d54bf789c service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:28.738643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1095/2187] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:30:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:30:28.906616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebb67-b39e-486b-8a30-6280af361d8d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:28.906826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebb67-b39e-486b-8a30-6280af361d8d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:28.908313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebb67-b39e-486b-8a30-6280af361d8d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:28.908669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1093/2188] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:30:28.917052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f0a0e-4ba2-4420-b4c2-3d1ac013b276 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:28.917366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f0a0e-4ba2-4420-b4c2-3d1ac013b276 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:28.917650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f0a0e-4ba2-4420-b4c2-3d1ac013b276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:28.962676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-292f0a0e-4ba2-4420-b4c2-3d1ac013b276 None None] MFA Rules not processed for user `7eab2497edff4c968030b5b0d6814150`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:28.966722 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-292f0a0e-4ba2-4420-b4c2-3d1ac013b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:29.117976 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1096/2189] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:30:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:29.139894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ebb67-b39e-486b-8a30-6280af361d8d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:29.141767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a62ebb67-b39e-486b-8a30-6280af361d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:29.170379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ebb67-b39e-486b-8a30-6280af361d8d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:29.175863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f95b1-6c3a-41d7-b4e5-57e6de2e391c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:29.178919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f95b1-6c3a-41d7-b4e5-57e6de2e391c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:29.179600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f95b1-6c3a-41d7-b4e5-57e6de2e391c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:29.180194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f95b1-6c3a-41d7-b4e5-57e6de2e391c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:29.195908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f95b1-6c3a-41d7-b4e5-57e6de2e391c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:29.199932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f95b1-6c3a-41d7-b4e5-57e6de2e391c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:29.218494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1094/2190] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:30:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:30:29.446177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eace19-4cee-490d-ad81-64a02df0c592 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:29.449845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eace19-4cee-490d-ad81-64a02df0c592 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:29.451543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eace19-4cee-490d-ad81-64a02df0c592 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:29.453684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1097/2191] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:30:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:30:29.465641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1229-a73a-4591-bb39-f4207e6cdf87 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:29.468345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1229-a73a-4591-bb39-f4207e6cdf87 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:29.469714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1229-a73a-4591-bb39-f4207e6cdf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:29.524760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7e6e1229-a73a-4591-bb39-f4207e6cdf87 None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:29.526440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7e6e1229-a73a-4591-bb39-f4207e6cdf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:29.555355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1095/2192] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:30:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:29.578781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eace19-4cee-490d-ad81-64a02df0c592 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:29.608269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eace19-4cee-490d-ad81-64a02df0c592 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:29.630717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c61a60-a472-4e8a-a876-76515304f8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:29.632949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c61a60-a472-4e8a-a876-76515304f8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:29.635745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c61a60-a472-4e8a-a876-76515304f8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:29.636328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c61a60-a472-4e8a-a876-76515304f8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:29.666849 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c61a60-a472-4e8a-a876-76515304f8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:29.668610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c61a60-a472-4e8a-a876-76515304f8c2 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:29.697883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1098/2193] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:30:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:30:31.327396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ece38-a022-42ab-b682-a6c2ac10e1b5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:31.328667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ece38-a022-42ab-b682-a6c2ac10e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:31.329803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ece38-a022-42ab-b682-a6c2ac10e1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:31.374264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-409ece38-a022-42ab-b682-a6c2ac10e1b5 None None] MFA Rules not processed for user `a3662d1d20f246688748796d04d87101`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:31.376412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-409ece38-a022-42ab-b682-a6c2ac10e1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:31.476120 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:31.511986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1096/2194] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:31.547806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c61a60-a472-4e8a-a876-76515304f8c2 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:31.561163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c61a60-a472-4e8a-a876-76515304f8c2 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:31.565324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1501-dd76-4227-85d8-54f7f9a32e94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb8054ea4249d18903b5998fa753d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:31.566392 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1501-dd76-4227-85d8-54f7f9a32e94 service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:31.566672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1501-dd76-4227-85d8-54f7f9a32e94 service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:31.566949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1501-dd76-4227-85d8-54f7f9a32e94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:31.670129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc1501-dd76-4227-85d8-54f7f9a32e94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:31.671793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc1501-dd76-4227-85d8-54f7f9a32e94 service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:31.689988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1099/2195] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:30:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:30:31.869156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f0f6d-c8b1-486d-bdf3-e91ba689d952 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:31.869481 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f0f6d-c8b1-486d-bdf3-e91ba689d952 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:31.869749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f0f6d-c8b1-486d-bdf3-e91ba689d952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:31.898587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ab1f0f6d-c8b1-486d-bdf3-e91ba689d952 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:31.899820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ab1f0f6d-c8b1-486d-bdf3-e91ba689d952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:32.002484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1097/2196] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:30:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:32.022958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1501-dd76-4227-85d8-54f7f9a32e94 service glance] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:32.027512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bffc1501-dd76-4227-85d8-54f7f9a32e94 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:32.073604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:32.260340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1501-dd76-4227-85d8-54f7f9a32e94 service glance] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:32.269147 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c1211-aa2a-4385-899f-19c1836734b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:32.269880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c1211-aa2a-4385-899f-19c1836734b4 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:32.270165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c1211-aa2a-4385-899f-19c1836734b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:32.270439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c1211-aa2a-4385-899f-19c1836734b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:32.284552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c1211-aa2a-4385-899f-19c1836734b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:32.288184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c1211-aa2a-4385-899f-19c1836734b4 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:32.304705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1100/2197] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:30:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:30:35.334435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17458274-1904-4ec8-83fb-a29406e21c05 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:35.335294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17458274-1904-4ec8-83fb-a29406e21c05 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:35.335723 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17458274-1904-4ec8-83fb-a29406e21c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:35.395049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-17458274-1904-4ec8-83fb-a29406e21c05 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:35.396720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-17458274-1904-4ec8-83fb-a29406e21c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:35.423665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1098/2198] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:30:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:35.444421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c1211-aa2a-4385-899f-19c1836734b4 service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:35.460203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c1211-aa2a-4385-899f-19c1836734b4 service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:35.470313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050ac76-3eff-4721-b65b-1d29ea71526b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:35.470924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ac76-3eff-4721-b65b-1d29ea71526b service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:35.471208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ac76-3eff-4721-b65b-1d29ea71526b service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:35.471526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ac76-3eff-4721-b65b-1d29ea71526b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:35.482187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050ac76-3eff-4721-b65b-1d29ea71526b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:35.484230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050ac76-3eff-4721-b65b-1d29ea71526b service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:35.505344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1101/2199] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:30:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:30:45.377535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=32 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:45.496362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=32 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:30:46.553129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc41769-ae43-425e-a576-8b748bd92003 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:46.553828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc41769-ae43-425e-a576-8b748bd92003 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:46.553828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc41769-ae43-425e-a576-8b748bd92003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:46.575238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9fc41769-ae43-425e-a576-8b748bd92003 None None] MFA Rules not processed for user `ff7969a7458e4237b4ba807433ca3c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:46.577107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9fc41769-ae43-425e-a576-8b748bd92003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:46.585121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1099/2200] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:30:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:51.871683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050ac76-3eff-4721-b65b-1d29ea71526b service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:51.873176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e050ac76-3eff-4721-b65b-1d29ea71526b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:51.971378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050ac76-3eff-4721-b65b-1d29ea71526b service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:51.977473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2bd2f-eccc-42b1-b8aa-b3344877185d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:51.978122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2bd2f-eccc-42b1-b8aa-b3344877185d service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:51.978400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2bd2f-eccc-42b1-b8aa-b3344877185d service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:51.978670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2bd2f-eccc-42b1-b8aa-b3344877185d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:51.980541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7be2bd2f-eccc-42b1-b8aa-b3344877185d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:51.992904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2bd2f-eccc-42b1-b8aa-b3344877185d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:51.994456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2bd2f-eccc-42b1-b8aa-b3344877185d service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:52.005178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1102/2201] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:30:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:30:55.780916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64b89e-40a5-4636-ac45-f3c309a315ce None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:55.781531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64b89e-40a5-4636-ac45-f3c309a315ce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:55.781682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64b89e-40a5-4636-ac45-f3c309a315ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:55.814595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fa64b89e-40a5-4636-ac45-f3c309a315ce None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:55.816259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fa64b89e-40a5-4636-ac45-f3c309a315ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:55.827831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1100/2202] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:30:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:55.861582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2bd2f-eccc-42b1-b8aa-b3344877185d service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:55.908344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2bd2f-eccc-42b1-b8aa-b3344877185d service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:55.918132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb37dd5-a1e3-40e1-a589-cae739cf1e6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:55.918782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb37dd5-a1e3-40e1-a589-cae739cf1e6e service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:55.919058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb37dd5-a1e3-40e1-a589-cae739cf1e6e service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:55.919326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb37dd5-a1e3-40e1-a589-cae739cf1e6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:55.940241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb37dd5-a1e3-40e1-a589-cae739cf1e6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:55.946133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb37dd5-a1e3-40e1-a589-cae739cf1e6e service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:55.971272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1103/2203] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:30:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:30:58.655893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e64f0-5d01-4596-87d0-8df60f430c2e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:58.656659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e64f0-5d01-4596-87d0-8df60f430c2e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:58.656659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e64f0-5d01-4596-87d0-8df60f430c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:58.687477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9d4e64f0-5d01-4596-87d0-8df60f430c2e None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:30:58.688838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9d4e64f0-5d01-4596-87d0-8df60f430c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:30:58.700535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1101/2204] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:30:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:30:58.711487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb37dd5-a1e3-40e1-a589-cae739cf1e6e service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:30:58.724151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb37dd5-a1e3-40e1-a589-cae739cf1e6e service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:30:58.731408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3128cfc-fe52-409a-9c6d-2e0db2f312c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:30:58.732368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3128cfc-fe52-409a-9c6d-2e0db2f312c4 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:30:58.732656 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3128cfc-fe52-409a-9c6d-2e0db2f312c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:30:58.732931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3128cfc-fe52-409a-9c6d-2e0db2f312c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:30:58.742603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3128cfc-fe52-409a-9c6d-2e0db2f312c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:30:58.744276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3128cfc-fe52-409a-9c6d-2e0db2f312c4 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:30:58.754149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1104/2205] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:30:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:31:08.688830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=9 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:08.755431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=44 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:11.021897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8141122-80e3-4b56-87f2-c72ae19ddffc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:11.022967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8141122-80e3-4b56-87f2-c72ae19ddffc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:11.023631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8141122-80e3-4b56-87f2-c72ae19ddffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:11.049778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d8141122-80e3-4b56-87f2-c72ae19ddffc None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:31:11.053286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d8141122-80e3-4b56-87f2-c72ae19ddffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:11.088712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1102/2206] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 26 07:31:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:31:11.101394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3128cfc-fe52-409a-9c6d-2e0db2f312c4 service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:11.117630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3128cfc-fe52-409a-9c6d-2e0db2f312c4 service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:11.124251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3318f99-cc59-4367-9a46-94e3c5ab95cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:11.125407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3318f99-cc59-4367-9a46-94e3c5ab95cb service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:11.126045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3318f99-cc59-4367-9a46-94e3c5ab95cb service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:11.126591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3318f99-cc59-4367-9a46-94e3c5ab95cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:11.157982 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3318f99-cc59-4367-9a46-94e3c5ab95cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:11.159949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3318f99-cc59-4367-9a46-94e3c5ab95cb service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:11.172858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1105/2207] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:31:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:31:19.365313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44583671-e2bf-41d8-94e3-f5c58e0cfb6f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:19.365822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44583671-e2bf-41d8-94e3-f5c58e0cfb6f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:19.365822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44583671-e2bf-41d8-94e3-f5c58e0cfb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:19.387276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-44583671-e2bf-41d8-94e3-f5c58e0cfb6f None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:31:19.388524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-44583671-e2bf-41d8-94e3-f5c58e0cfb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:19.398293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1103/2208] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 26 07:31:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:31:19.411868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3318f99-cc59-4367-9a46-94e3c5ab95cb service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:19.422267 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3318f99-cc59-4367-9a46-94e3c5ab95cb service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:19.428138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8260f1-eca8-46c3-bc4d-d3d5bbc94c82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:19.428887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8260f1-eca8-46c3-bc4d-d3d5bbc94c82 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:19.429226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8260f1-eca8-46c3-bc4d-d3d5bbc94c82 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:19.429591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8260f1-eca8-46c3-bc4d-d3d5bbc94c82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:19.438250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8260f1-eca8-46c3-bc4d-d3d5bbc94c82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:19.440008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8260f1-eca8-46c3-bc4d-d3d5bbc94c82 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:19.448750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1106/2209] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:31:21.088114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93de8-4929-4b95-9279-a715f167e2b0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:21.088660 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93de8-4929-4b95-9279-a715f167e2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:21.088769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93de8-4929-4b95-9279-a715f167e2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:21.119495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d0d93de8-4929-4b95-9279-a715f167e2b0 None None] MFA Rules not processed for user `b9ece518ba544f5190bb914ccb3fe63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:31:21.121954 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d0d93de8-4929-4b95-9279-a715f167e2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:21.187164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1104/2210] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:31:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:31:21.843680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8260f1-eca8-46c3-bc4d-d3d5bbc94c82 service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:21.845353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4c8260f1-eca8-46c3-bc4d-d3d5bbc94c82 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:21.913031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8260f1-eca8-46c3-bc4d-d3d5bbc94c82 service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:21.917833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:21.918491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:21.918771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:21.919043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] PATH_INFO: `/v3/users/4d09b79ca62b4061a379232eff4aad49` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:21.920218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d09b79ca62b4061a379232eff4aad49)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:21.922190 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:21.985670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d09b79ca62b4061a379232eff4aad49'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:21.986525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d09b79ca62b4061a379232eff4aad49'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:21.987195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d09b79ca62b4061a379232eff4aad49'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:22.001761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d09b79ca62b4061a379232eff4aad49'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:22.013113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08c57dbf-0570-453c-afc2-74df9c784b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d09b79ca62b4061a379232eff4aad49'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:22.030359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1107/2211] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:31:21 2022] DELETE /identity/v3/users/4d09b79ca62b4061a379232eff4aad49 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:31:22.233669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d93de8-4929-4b95-9279-a715f167e2b0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:22.261326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d93de8-4929-4b95-9279-a715f167e2b0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:22.335057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:22.336221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:22.336645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:22.336927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] PATH_INFO: `/v3/projects/77611da3202f4ab18966d4a9f3f00090` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:22.338277 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=77611da3202f4ab18966d4a9f3f00090)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:22.340646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:22.405947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77611da3202f4ab18966d4a9f3f00090', 'request_id': 'req-844b47db-96af-4557-b699-9da8ea16e4ce'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:22.416019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77611da3202f4ab18966d4a9f3f00090', 'request_id': 'req-844b47db-96af-4557-b699-9da8ea16e4ce'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:22.423579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77611da3202f4ab18966d4a9f3f00090', 'request_id': 'req-844b47db-96af-4557-b699-9da8ea16e4ce'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:22.437292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] The token cache is being invalidate because project 77611da3202f4ab18966d4a9f3f00090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:31:22.437739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:22.438978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-844b47db-96af-4557-b699-9da8ea16e4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:22.440829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1105/2212] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:31:22 2022] DELETE /identity/v3/projects/77611da3202f4ab18966d4a9f3f00090 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:31:22.446729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5430-48a0-4d0e-b9ff-3bfce0e9b182 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:22.447026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5430-48a0-4d0e-b9ff-3bfce0e9b182 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:22.447370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5430-48a0-4d0e-b9ff-3bfce0e9b182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:22.468761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b4ac5430-48a0-4d0e-b9ff-3bfce0e9b182 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:31:22.470043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b4ac5430-48a0-4d0e-b9ff-3bfce0e9b182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:22.541756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:22.563433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1108/2213] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:31:22.571919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883f7ec-eb4a-4313-85eb-0086302d8098 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:22.572611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883f7ec-eb4a-4313-85eb-0086302d8098 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:22.573012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883f7ec-eb4a-4313-85eb-0086302d8098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:22.598927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e883f7ec-eb4a-4313-85eb-0086302d8098 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:31:22.600161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e883f7ec-eb4a-4313-85eb-0086302d8098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:22.608327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1106/2214] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:31:22.612884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5430-48a0-4d0e-b9ff-3bfce0e9b182 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:22.625023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5430-48a0-4d0e-b9ff-3bfce0e9b182 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:22.633621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c2a9c-177d-4073-b0b6-ca207206bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:22.634349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c2a9c-177d-4073-b0b6-ca207206bdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:22.634717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c2a9c-177d-4073-b0b6-ca207206bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:22.635048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c2a9c-177d-4073-b0b6-ca207206bdc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:22.635831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c2a9c-177d-4073-b0b6-ca207206bdc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:31:22.636255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c2a9c-177d-4073-b0b6-ca207206bdc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:22.637980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c2a9c-177d-4073-b0b6-ca207206bdc7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:22.651049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1109/2215] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:31:22.655666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883f7ec-eb4a-4313-85eb-0086302d8098 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:22.665293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883f7ec-eb4a-4313-85eb-0086302d8098 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:22.670193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c091b9-b03b-496b-bc4a-0414606057c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:22.670813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c091b9-b03b-496b-bc4a-0414606057c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:22.671088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c091b9-b03b-496b-bc4a-0414606057c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:22.671356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c091b9-b03b-496b-bc4a-0414606057c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:22.672024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c091b9-b03b-496b-bc4a-0414606057c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:22.674053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c091b9-b03b-496b-bc4a-0414606057c4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:22.698316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:22.720796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1107/2216] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:31:22 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:31:22.725322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c2a9c-177d-4073-b0b6-ca207206bdc7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:22.742251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c2a9c-177d-4073-b0b6-ca207206bdc7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:22.819872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82fa8e-747c-48f1-83d0-6c9f79d6907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:22.820598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82fa8e-747c-48f1-83d0-6c9f79d6907e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:22.820877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82fa8e-747c-48f1-83d0-6c9f79d6907e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:22.821144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82fa8e-747c-48f1-83d0-6c9f79d6907e admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:22.821869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82fa8e-747c-48f1-83d0-6c9f79d6907e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:22.824839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82fa8e-747c-48f1-83d0-6c9f79d6907e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:22.850336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1110/2217] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:31:22 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:31:22.859399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c091b9-b03b-496b-bc4a-0414606057c4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:22.870827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c091b9-b03b-496b-bc4a-0414606057c4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:22.876015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247dc22-9d21-4caa-9679-eac7995e11b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:22.876710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247dc22-9d21-4caa-9679-eac7995e11b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:22.877048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247dc22-9d21-4caa-9679-eac7995e11b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:22.877345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247dc22-9d21-4caa-9679-eac7995e11b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:22.878850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247dc22-9d21-4caa-9679-eac7995e11b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:22.880707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247dc22-9d21-4caa-9679-eac7995e11b5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:22.894961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1108/2218] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:31:22.899167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82fa8e-747c-48f1-83d0-6c9f79d6907e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:22.912654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82fa8e-747c-48f1-83d0-6c9f79d6907e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:22.917280 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884cb83-79bf-47ea-bcd0-ff20f53dbe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:22.917965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884cb83-79bf-47ea-bcd0-ff20f53dbe83 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:22.918184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884cb83-79bf-47ea-bcd0-ff20f53dbe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:22.918626 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884cb83-79bf-47ea-bcd0-ff20f53dbe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:22.919337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884cb83-79bf-47ea-bcd0-ff20f53dbe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:22.920933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884cb83-79bf-47ea-bcd0-ff20f53dbe83 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:22.941598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1111/2219] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:31:22.945853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247dc22-9d21-4caa-9679-eac7995e11b5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:22.956675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247dc22-9d21-4caa-9679-eac7995e11b5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:22.961249 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324399e-8614-423d-a162-ee792d394fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:22.961961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324399e-8614-423d-a162-ee792d394fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:22.962238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324399e-8614-423d-a162-ee792d394fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:22.962508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324399e-8614-423d-a162-ee792d394fcd admin admin] PATH_INFO: `/v3/projects/dda16269a3204f568c9ebf8eb5635ee8/users/83976035919142acacc896b48e24ae43/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:22.978307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324399e-8614-423d-a162-ee792d394fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda16269a3204f568c9ebf8eb5635ee8, user_id=83976035919142acacc896b48e24ae43, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:22.980947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324399e-8614-423d-a162-ee792d394fcd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:22.996267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1109/2220] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:31:22 2022] PUT /identity/v3/projects/dda16269a3204f568c9ebf8eb5635ee8/users/83976035919142acacc896b48e24ae43/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:31:23.006937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a868-5f63-4424-9357-058938097a15 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:23.007246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a868-5f63-4424-9357-058938097a15 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:23.007505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a868-5f63-4424-9357-058938097a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:23.043639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a7d2a868-5f63-4424-9357-058938097a15 None None] MFA Rules not processed for user `83976035919142acacc896b48e24ae43`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:31:23.045487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a7d2a868-5f63-4424-9357-058938097a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:23.118998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1112/2221] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:31:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:31:23.132256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324399e-8614-423d-a162-ee792d394fcd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:23.134340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2324399e-8614-423d-a162-ee792d394fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:23.203084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324399e-8614-423d-a162-ee792d394fcd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:23.207060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e83b64-2537-4cb6-a61a-ea08770b0eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:23.207648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e83b64-2537-4cb6-a61a-ea08770b0eaa service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:23.207929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e83b64-2537-4cb6-a61a-ea08770b0eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:23.208201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e83b64-2537-4cb6-a61a-ea08770b0eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:23.217474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e83b64-2537-4cb6-a61a-ea08770b0eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:23.218920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e83b64-2537-4cb6-a61a-ea08770b0eaa service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:23.227999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1110/2222] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:31:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:31:25.442370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a868-5f63-4424-9357-058938097a15 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:25.444620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a7d2a868-5f63-4424-9357-058938097a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:25.523727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:25.529232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a868-5f63-4424-9357-058938097a15 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:25.535499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbec02-4d5b-467d-8710-4cfba8e8c06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:25.536214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbec02-4d5b-467d-8710-4cfba8e8c06b service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:25.537100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbec02-4d5b-467d-8710-4cfba8e8c06b service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:25.537470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbec02-4d5b-467d-8710-4cfba8e8c06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:25.539288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-55dbec02-4d5b-467d-8710-4cfba8e8c06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:25.669872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbec02-4d5b-467d-8710-4cfba8e8c06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:25.671651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbec02-4d5b-467d-8710-4cfba8e8c06b service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:25.691868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1113/2223] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:31:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:31:28.411274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e83b64-2537-4cb6-a61a-ea08770b0eaa service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:28.503168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e83b64-2537-4cb6-a61a-ea08770b0eaa service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:28.509202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:28.509992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:28.510324 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:28.510602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] PATH_INFO: `/v3/users/83976035919142acacc896b48e24ae43` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:28.512454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83976035919142acacc896b48e24ae43)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:28.514545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:28.571909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83976035919142acacc896b48e24ae43'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:28.582276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83976035919142acacc896b48e24ae43'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:28.590844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:28.608282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83976035919142acacc896b48e24ae43'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:28.619819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83976035919142acacc896b48e24ae43'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:28.620729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83976035919142acacc896b48e24ae43'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:28.628202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1111/2224] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:31:28 2022] DELETE /identity/v3/users/83976035919142acacc896b48e24ae43 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:31:28.632757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ac7e-a28b-4784-a4a2-b5813ba8793e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:28.633236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ac7e-a28b-4784-a4a2-b5813ba8793e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:28.633643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ac7e-a28b-4784-a4a2-b5813ba8793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:28.654959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2543ac7e-a28b-4784-a4a2-b5813ba8793e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:31:28.656323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2543ac7e-a28b-4784-a4a2-b5813ba8793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:28.731171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1114/2225] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:31:28.746127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:28.748397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:28.820061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3700a6f-3c89-47ec-b56a-916105aae595 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:28.824894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffad25-0dcc-47be-b155-bca552d35bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:28.825831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffad25-0dcc-47be-b155-bca552d35bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:28.826108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffad25-0dcc-47be-b155-bca552d35bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:28.826377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffad25-0dcc-47be-b155-bca552d35bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:28.837799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffad25-0dcc-47be-b155-bca552d35bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:28.839669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffad25-0dcc-47be-b155-bca552d35bd3 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:28.851866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1112/2226] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:31:29.227857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543ac7e-a28b-4784-a4a2-b5813ba8793e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:31:29.229532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2543ac7e-a28b-4784-a4a2-b5813ba8793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:29.247014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543ac7e-a28b-4784-a4a2-b5813ba8793e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:31:29.254365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:31:29.263980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:29.264306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:29.264584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] PATH_INFO: `/v3/projects/dda16269a3204f568c9ebf8eb5635ee8` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:29.266475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda16269a3204f568c9ebf8eb5635ee8)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:31:29.269033 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:31:29.323653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda16269a3204f568c9ebf8eb5635ee8', 'request_id': 'req-471d741e-05f2-47ea-befe-2dfa64d8f55f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:29.332244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda16269a3204f568c9ebf8eb5635ee8', 'request_id': 'req-471d741e-05f2-47ea-befe-2dfa64d8f55f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:29.339335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda16269a3204f568c9ebf8eb5635ee8', 'request_id': 'req-471d741e-05f2-47ea-befe-2dfa64d8f55f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:29.350885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] The token cache is being invalidate because project dda16269a3204f568c9ebf8eb5635ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:31:29.351166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:29.351813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-471d741e-05f2-47ea-befe-2dfa64d8f55f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:31:29.353688 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1115/2227] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:31:29 2022] DELETE /identity/v3/projects/dda16269a3204f568c9ebf8eb5635ee8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:31:31.933044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab8dd9-948a-4e98-bf18-97f1c7e51677 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:31.933657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab8dd9-948a-4e98-bf18-97f1c7e51677 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:31.933657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab8dd9-948a-4e98-bf18-97f1c7e51677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:31.953882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e4ab8dd9-948a-4e98-bf18-97f1c7e51677 None None] MFA Rules not processed for user `6bc826246d4d4c2f8c837d1fe0d3f13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:31:31.955158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e4ab8dd9-948a-4e98-bf18-97f1c7e51677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:31:32.015334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1113/2228] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:31:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:31:39.348376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:42.007938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=59,keystone:DELETE=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:31:59.934141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008458d3-fdf6-445d-afd2-ec803490a3e0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:31:59.934627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008458d3-fdf6-445d-afd2-ec803490a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:31:59.934724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008458d3-fdf6-445d-afd2-ec803490a3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:31:59.954316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-008458d3-fdf6-445d-afd2-ec803490a3e0 None None] MFA Rules not processed for user `4a31e0a8824e44c288526ddd0b750394`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:31:59.955517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-008458d3-fdf6-445d-afd2-ec803490a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:00.021611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1116/2229] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:31:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:08.339259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0220d0e-c049-42ef-bdd1-f404edeac516 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:08.339746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0220d0e-c049-42ef-bdd1-f404edeac516 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:08.339836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0220d0e-c049-42ef-bdd1-f404edeac516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:08.359855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a0220d0e-c049-42ef-bdd1-f404edeac516 None None] MFA Rules not processed for user `d9934866496945b7bdebd7e7e78c24b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:08.361113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a0220d0e-c049-42ef-bdd1-f404edeac516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:08.428544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1114/2230] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:10.013582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=25 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:18.421314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=25 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:38.927132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a6084-2133-4a14-a771-f3e5032705c1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:38.927846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a6084-2133-4a14-a771-f3e5032705c1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:38.927846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a6084-2133-4a14-a771-f3e5032705c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:38.951146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e58a6084-2133-4a14-a771-f3e5032705c1 None None] MFA Rules not processed for user `b9ece518ba544f5190bb914ccb3fe63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:38.952395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e58a6084-2133-4a14-a771-f3e5032705c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:39.010698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1117/2231] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:39.049092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0220d0e-c049-42ef-bdd1-f404edeac516 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:39.049654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a6084-2133-4a14-a771-f3e5032705c1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:39.050690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a0220d0e-c049-42ef-bdd1-f404edeac516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:39.050867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e58a6084-2133-4a14-a771-f3e5032705c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:39.108846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a6084-2133-4a14-a771-f3e5032705c1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:39.112326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0220d0e-c049-42ef-bdd1-f404edeac516 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:39.113864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309b269-a140-4285-84b9-2322b86aa29f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb8054ea4249d18903b5998fa753d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:39.114585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309b269-a140-4285-84b9-2322b86aa29f service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:39.114896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309b269-a140-4285-84b9-2322b86aa29f service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:39.115311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309b269-a140-4285-84b9-2322b86aa29f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:39.116488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:39.117125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:39.117252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3309b269-a140-4285-84b9-2322b86aa29f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:39.117458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:39.117707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:39.119538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:39.196874 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309b269-a140-4285-84b9-2322b86aa29f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:39.199200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309b269-a140-4285-84b9-2322b86aa29f service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:39.199720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:39.203929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:39.212132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1118/2232] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:32:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:32:39.226670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1115/2233] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:32:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:32:42.801548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309b269-a140-4285-84b9-2322b86aa29f service glance] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:42.811787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309b269-a140-4285-84b9-2322b86aa29f service glance] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:42.816732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eee25d-06d4-426a-baa0-d2320199c42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:42.817619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eee25d-06d4-426a-baa0-d2320199c42f service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:42.817915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eee25d-06d4-426a-baa0-d2320199c42f service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:42.818119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eee25d-06d4-426a-baa0-d2320199c42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:42.820088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4eee25d-06d4-426a-baa0-d2320199c42f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:42.874442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:42.895708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eee25d-06d4-426a-baa0-d2320199c42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:42.897839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eee25d-06d4-426a-baa0-d2320199c42f service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:42.909674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1119/2234] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:32:46.412443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:46.414084 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:46.429149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7f2b3-9f4a-47db-80f4-213b2bcda68b service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:46.434870 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:46.435524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:46.435800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:46.436066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] PATH_INFO: `/v3/users/6bc826246d4d4c2f8c837d1fe0d3f13c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:46.437410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc826246d4d4c2f8c837d1fe0d3f13c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:46.439511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:46.492686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc826246d4d4c2f8c837d1fe0d3f13c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.501908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc826246d4d4c2f8c837d1fe0d3f13c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.514406 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc826246d4d4c2f8c837d1fe0d3f13c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.521377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc826246d4d4c2f8c837d1fe0d3f13c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.522056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10347db4-9fd4-4a61-b626-25a7f4ea7afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc826246d4d4c2f8c837d1fe0d3f13c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.528407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1116/2235] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:32:46 2022] DELETE /identity/v3/users/6bc826246d4d4c2f8c837d1fe0d3f13c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:46.716684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eee25d-06d4-426a-baa0-d2320199c42f service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:46.727545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eee25d-06d4-426a-baa0-d2320199c42f service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:46.787963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:46.788627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:46.788913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:46.789188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] PATH_INFO: `/v3/projects/4375a44247ab47dd948bbfba321da75f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:46.790400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4375a44247ab47dd948bbfba321da75f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:46.792351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:46.860504 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4375a44247ab47dd948bbfba321da75f', 'request_id': 'req-b97d6b52-e77a-4ef1-a611-df7437426347'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.871866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4375a44247ab47dd948bbfba321da75f', 'request_id': 'req-b97d6b52-e77a-4ef1-a611-df7437426347'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.879648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4375a44247ab47dd948bbfba321da75f', 'request_id': 'req-b97d6b52-e77a-4ef1-a611-df7437426347'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.895857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] The token cache is being invalidate because project 4375a44247ab47dd948bbfba321da75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:32:46.896156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.896898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b97d6b52-e77a-4ef1-a611-df7437426347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:46.898609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1120/2236] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:32:46 2022] DELETE /identity/v3/projects/4375a44247ab47dd948bbfba321da75f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:46.903716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490eb0e-e10e-4f3c-a80e-f785cdecd610 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:46.904015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490eb0e-e10e-4f3c-a80e-f785cdecd610 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:46.904347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490eb0e-e10e-4f3c-a80e-f785cdecd610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:46.926109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8490eb0e-e10e-4f3c-a80e-f785cdecd610 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:46.927309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8490eb0e-e10e-4f3c-a80e-f785cdecd610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:46.937283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:46.994581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1117/2237] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:47.002863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001349b-aab2-4ede-b356-fa685d8047b6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:47.003150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001349b-aab2-4ede-b356-fa685d8047b6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:47.003426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001349b-aab2-4ede-b356-fa685d8047b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:47.024692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d001349b-aab2-4ede-b356-fa685d8047b6 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:47.026172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d001349b-aab2-4ede-b356-fa685d8047b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:47.034966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1121/2238] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:47.039236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490eb0e-e10e-4f3c-a80e-f785cdecd610 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:47.049590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490eb0e-e10e-4f3c-a80e-f785cdecd610 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:47.054471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f2e0-84e7-4f8d-a55f-42e9c4b0367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:47.055109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f2e0-84e7-4f8d-a55f-42e9c4b0367f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:47.055391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f2e0-84e7-4f8d-a55f-42e9c4b0367f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:47.055665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f2e0-84e7-4f8d-a55f-42e9c4b0367f admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:47.056376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f2e0-84e7-4f8d-a55f-42e9c4b0367f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:32:47.056684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f2e0-84e7-4f8d-a55f-42e9c4b0367f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:47.058315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f2e0-84e7-4f8d-a55f-42e9c4b0367f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:47.070576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1118/2239] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:32:47.075349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001349b-aab2-4ede-b356-fa685d8047b6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:47.085375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001349b-aab2-4ede-b356-fa685d8047b6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:47.091086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece07a8-9f4d-482e-b6a2-94b12cf06a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:47.091698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece07a8-9f4d-482e-b6a2-94b12cf06a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:47.091973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece07a8-9f4d-482e-b6a2-94b12cf06a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:47.092241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece07a8-9f4d-482e-b6a2-94b12cf06a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:47.092881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece07a8-9f4d-482e-b6a2-94b12cf06a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:47.094957 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece07a8-9f4d-482e-b6a2-94b12cf06a3f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:47.127532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1122/2240] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:32:47 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:32:47.131971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f2e0-84e7-4f8d-a55f-42e9c4b0367f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:47.142905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f2e0-84e7-4f8d-a55f-42e9c4b0367f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:47.208623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd01e-dad3-48e4-b756-88d1ec922d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:47.209608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd01e-dad3-48e4-b756-88d1ec922d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:47.210022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd01e-dad3-48e4-b756-88d1ec922d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:47.210370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd01e-dad3-48e4-b756-88d1ec922d13 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:47.211415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd01e-dad3-48e4-b756-88d1ec922d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:47.214527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd01e-dad3-48e4-b756-88d1ec922d13 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:47.242764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1119/2241] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:32:47 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:32:47.247195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece07a8-9f4d-482e-b6a2-94b12cf06a3f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:47.257658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece07a8-9f4d-482e-b6a2-94b12cf06a3f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:47.262558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368084d7-2141-4733-8ce3-84786e51155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:47.263244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368084d7-2141-4733-8ce3-84786e51155d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:47.263523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368084d7-2141-4733-8ce3-84786e51155d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:47.263814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368084d7-2141-4733-8ce3-84786e51155d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:47.264527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368084d7-2141-4733-8ce3-84786e51155d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:47.266218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368084d7-2141-4733-8ce3-84786e51155d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:47.276516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1123/2242] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:32:47.280801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd01e-dad3-48e4-b756-88d1ec922d13 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:47.296916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd01e-dad3-48e4-b756-88d1ec922d13 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:47.303659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c797-a5ca-4627-8c99-5665a8eaa642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:47.304712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c797-a5ca-4627-8c99-5665a8eaa642 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:47.305194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c797-a5ca-4627-8c99-5665a8eaa642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:47.305715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c797-a5ca-4627-8c99-5665a8eaa642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:47.306761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c797-a5ca-4627-8c99-5665a8eaa642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:47.308388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c797-a5ca-4627-8c99-5665a8eaa642 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:47.323533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1120/2243] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:32:47.328106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368084d7-2141-4733-8ce3-84786e51155d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:47.338680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368084d7-2141-4733-8ce3-84786e51155d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:47.343745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac83ff-fd8b-44bc-9089-4b2fccf55334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:47.344422 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac83ff-fd8b-44bc-9089-4b2fccf55334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:47.344693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac83ff-fd8b-44bc-9089-4b2fccf55334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:47.344970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac83ff-fd8b-44bc-9089-4b2fccf55334 admin admin] PATH_INFO: `/v3/projects/922eab8d3a4a4c28a4f6faf2c1b2016f/users/15fc10127f7c4ed2b28b24d1cf183ed5/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:47.363618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac83ff-fd8b-44bc-9089-4b2fccf55334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922eab8d3a4a4c28a4f6faf2c1b2016f, user_id=15fc10127f7c4ed2b28b24d1cf183ed5, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:47.366341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac83ff-fd8b-44bc-9089-4b2fccf55334 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:47.380931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1124/2244] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:32:47 2022] PUT /identity/v3/projects/922eab8d3a4a4c28a4f6faf2c1b2016f/users/15fc10127f7c4ed2b28b24d1cf183ed5/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:32:47.391606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392ea5-fbce-459b-b687-4059f1a15f31 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:47.391890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392ea5-fbce-459b-b687-4059f1a15f31 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:47.392160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392ea5-fbce-459b-b687-4059f1a15f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:47.422477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e7392ea5-fbce-459b-b687-4059f1a15f31 None None] MFA Rules not processed for user `15fc10127f7c4ed2b28b24d1cf183ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:47.423709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e7392ea5-fbce-459b-b687-4059f1a15f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:47.503644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1121/2245] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:47.518413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac83ff-fd8b-44bc-9089-4b2fccf55334 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:47.520230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2fac83ff-fd8b-44bc-9089-4b2fccf55334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:47.531266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:47.599255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac83ff-fd8b-44bc-9089-4b2fccf55334 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:47.606515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f227cd-8345-4c5c-b285-754c0adee8b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:47.607163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f227cd-8345-4c5c-b285-754c0adee8b5 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:47.607443 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f227cd-8345-4c5c-b285-754c0adee8b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:47.607718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f227cd-8345-4c5c-b285-754c0adee8b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:47.617250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f227cd-8345-4c5c-b285-754c0adee8b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:47.618942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f227cd-8345-4c5c-b285-754c0adee8b5 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:47.629298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1125/2246] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:32:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:32:50.346042 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392ea5-fbce-459b-b687-4059f1a15f31 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:50.355434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:50.414902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392ea5-fbce-459b-b687-4059f1a15f31 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:50.420736 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:50.421567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:50.421950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:50.422444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] PATH_INFO: `/v3/users/15fc10127f7c4ed2b28b24d1cf183ed5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:50.423806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fc10127f7c4ed2b28b24d1cf183ed5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:50.426142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:50.485362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fc10127f7c4ed2b28b24d1cf183ed5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:50.496575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fc10127f7c4ed2b28b24d1cf183ed5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:50.514255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fc10127f7c4ed2b28b24d1cf183ed5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:50.525344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fc10127f7c4ed2b28b24d1cf183ed5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:50.526100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fc10127f7c4ed2b28b24d1cf183ed5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:50.535150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1122/2247] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:32:50 2022] DELETE /identity/v3/users/15fc10127f7c4ed2b28b24d1cf183ed5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:50.539643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb2e3-81a7-4c2b-8791-033445985c7f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:50.540201 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb2e3-81a7-4c2b-8791-033445985c7f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:50.540201 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb2e3-81a7-4c2b-8791-033445985c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:50.559927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a11eb2e3-81a7-4c2b-8791-033445985c7f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:50.561339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a11eb2e3-81a7-4c2b-8791-033445985c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:50.640313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1126/2248] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:50.650185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:50.651639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:50.716982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaae87-d955-4fb4-9110-2b0946cca675 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:50.721406 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43ef19-a666-4193-b2d7-eac31b998d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:50.722088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ef19-a666-4193-b2d7-eac31b998d75 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:50.724208 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ef19-a666-4193-b2d7-eac31b998d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:50.724518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ef19-a666-4193-b2d7-eac31b998d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:50.734717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43ef19-a666-4193-b2d7-eac31b998d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:50.736169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43ef19-a666-4193-b2d7-eac31b998d75 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:50.745969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1123/2249] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:32:51.108709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb2e3-81a7-4c2b-8791-033445985c7f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:51.110379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a11eb2e3-81a7-4c2b-8791-033445985c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:51.123570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb2e3-81a7-4c2b-8791-033445985c7f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:51.128901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:51.129603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.129885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.130158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] PATH_INFO: `/v3/projects/922eab8d3a4a4c28a4f6faf2c1b2016f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.131421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922eab8d3a4a4c28a4f6faf2c1b2016f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:51.133496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:51.181393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922eab8d3a4a4c28a4f6faf2c1b2016f', 'request_id': 'req-d5b04007-cb47-4b7d-9e73-212cbc59cf62'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:51.189553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922eab8d3a4a4c28a4f6faf2c1b2016f', 'request_id': 'req-d5b04007-cb47-4b7d-9e73-212cbc59cf62'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:51.195071 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922eab8d3a4a4c28a4f6faf2c1b2016f', 'request_id': 'req-d5b04007-cb47-4b7d-9e73-212cbc59cf62'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:51.209474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] The token cache is being invalidate because project 922eab8d3a4a4c28a4f6faf2c1b2016f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:32:51.209727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:51.210451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5b04007-cb47-4b7d-9e73-212cbc59cf62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:51.212084 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1127/2250] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:32:51 2022] DELETE /identity/v3/projects/922eab8d3a4a4c28a4f6faf2c1b2016f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:51.217169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a028-3b74-4492-94dd-7f447862ec7b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.217495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a028-3b74-4492-94dd-7f447862ec7b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.217772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a028-3b74-4492-94dd-7f447862ec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.238395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3e51a028-3b74-4492-94dd-7f447862ec7b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:51.239614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3e51a028-3b74-4492-94dd-7f447862ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:51.266955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:51.306699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1124/2251] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:51.316155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bf7e-ce2f-4f37-bc29-fbcd37d73181 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.316434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bf7e-ce2f-4f37-bc29-fbcd37d73181 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.316707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bf7e-ce2f-4f37-bc29-fbcd37d73181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.338589 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6e10bf7e-ce2f-4f37-bc29-fbcd37d73181 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:51.339795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6e10bf7e-ce2f-4f37-bc29-fbcd37d73181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:51.348830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1128/2252] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:51.353917 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a028-3b74-4492-94dd-7f447862ec7b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:51.366664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a028-3b74-4492-94dd-7f447862ec7b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:51.371979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76268fa5-959e-4cea-966e-f717819026bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:51.372595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268fa5-959e-4cea-966e-f717819026bf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.372869 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268fa5-959e-4cea-966e-f717819026bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.373137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268fa5-959e-4cea-966e-f717819026bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.373871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76268fa5-959e-4cea-966e-f717819026bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:32:51.374171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76268fa5-959e-4cea-966e-f717819026bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:51.375817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76268fa5-959e-4cea-966e-f717819026bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:51.388429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1125/2253] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:32:51.392825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bf7e-ce2f-4f37-bc29-fbcd37d73181 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:51.402713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bf7e-ce2f-4f37-bc29-fbcd37d73181 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:51.408735 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55c5f7-42d7-49ef-a6ac-8ed5eec7bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:51.409413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55c5f7-42d7-49ef-a6ac-8ed5eec7bdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.409683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55c5f7-42d7-49ef-a6ac-8ed5eec7bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.409959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55c5f7-42d7-49ef-a6ac-8ed5eec7bdb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.410633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55c5f7-42d7-49ef-a6ac-8ed5eec7bdb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:51.412585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55c5f7-42d7-49ef-a6ac-8ed5eec7bdb6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:51.418600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:51.451207 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1129/2254] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:32:51 2022] POST /identity/v3/projects => generated 403 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:32:51.457302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76268fa5-959e-4cea-966e-f717819026bf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:51.468799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76268fa5-959e-4cea-966e-f717819026bf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:51.528173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb95d2-5895-4363-8f54-8e42fdb11d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:51.528785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb95d2-5895-4363-8f54-8e42fdb11d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.529066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb95d2-5895-4363-8f54-8e42fdb11d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.529413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb95d2-5895-4363-8f54-8e42fdb11d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.530052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb95d2-5895-4363-8f54-8e42fdb11d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:51.531995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb95d2-5895-4363-8f54-8e42fdb11d52 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:51.558097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1126/2255] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:32:51 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:32:51.568315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55c5f7-42d7-49ef-a6ac-8ed5eec7bdb6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:51.580872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55c5f7-42d7-49ef-a6ac-8ed5eec7bdb6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:51.588993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253cf39-c9d8-4787-83d8-12dbffa484c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:51.589659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253cf39-c9d8-4787-83d8-12dbffa484c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.589936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253cf39-c9d8-4787-83d8-12dbffa484c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.590211 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253cf39-c9d8-4787-83d8-12dbffa484c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.590910 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253cf39-c9d8-4787-83d8-12dbffa484c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:51.592528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253cf39-c9d8-4787-83d8-12dbffa484c3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:51.603454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1130/2256] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:32:51.608010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb95d2-5895-4363-8f54-8e42fdb11d52 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:51.619092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb95d2-5895-4363-8f54-8e42fdb11d52 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:51.624392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fb0b2-fa6d-47a7-85ef-d02cba01d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:51.625013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb0b2-fa6d-47a7-85ef-d02cba01d585 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.625360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb0b2-fa6d-47a7-85ef-d02cba01d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.625686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb0b2-fa6d-47a7-85ef-d02cba01d585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.626377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fb0b2-fa6d-47a7-85ef-d02cba01d585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:51.628037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fb0b2-fa6d-47a7-85ef-d02cba01d585 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:51.639893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1127/2257] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:32:51.644301 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253cf39-c9d8-4787-83d8-12dbffa484c3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:51.654812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253cf39-c9d8-4787-83d8-12dbffa484c3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:51.659791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba81d37-05e2-4719-af6f-08cacbcf79c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:51.660464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba81d37-05e2-4719-af6f-08cacbcf79c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.660744 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba81d37-05e2-4719-af6f-08cacbcf79c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.661019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba81d37-05e2-4719-af6f-08cacbcf79c4 admin admin] PATH_INFO: `/v3/projects/0f23fdea15f64b148a27d14b42957ed5/users/a3d7085a3bb140d79887a711a8314638/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.676418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba81d37-05e2-4719-af6f-08cacbcf79c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f23fdea15f64b148a27d14b42957ed5, user_id=a3d7085a3bb140d79887a711a8314638, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:51.679106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba81d37-05e2-4719-af6f-08cacbcf79c4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:51.694277 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1131/2258] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:32:51 2022] PUT /identity/v3/projects/0f23fdea15f64b148a27d14b42957ed5/users/a3d7085a3bb140d79887a711a8314638/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:51.706162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18684-4794-4f03-91d8-4bc8751b7521 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.706608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18684-4794-4f03-91d8-4bc8751b7521 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.707029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18684-4794-4f03-91d8-4bc8751b7521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.736842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2fc18684-4794-4f03-91d8-4bc8751b7521 None None] MFA Rules not processed for user `a3d7085a3bb140d79887a711a8314638`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:51.738113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2fc18684-4794-4f03-91d8-4bc8751b7521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:51.811182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1128/2259] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:51.815877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba81d37-05e2-4719-af6f-08cacbcf79c4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:51.888854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba81d37-05e2-4719-af6f-08cacbcf79c4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:51.894594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d81f-4607-486c-ba3e-4483864cba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:51.895220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d81f-4607-486c-ba3e-4483864cba6b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:51.895500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d81f-4607-486c-ba3e-4483864cba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:51.895756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d81f-4607-486c-ba3e-4483864cba6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:51.896408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d81f-4607-486c-ba3e-4483864cba6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:51.898415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d81f-4607-486c-ba3e-4483864cba6b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:51.928519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1132/2260] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:32:51 2022] POST /identity/v3/projects => generated 405 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:32:51.932806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc18684-4794-4f03-91d8-4bc8751b7521 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:51.944247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc18684-4794-4f03-91d8-4bc8751b7521 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:51.976379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:52.030487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba80d3-761c-4b49-b880-4c1460db2428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:52.031112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba80d3-761c-4b49-b880-4c1460db2428 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:52.031393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba80d3-761c-4b49-b880-4c1460db2428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:52.031671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba80d3-761c-4b49-b880-4c1460db2428 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:52.032372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba80d3-761c-4b49-b880-4c1460db2428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:52.034494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba80d3-761c-4b49-b880-4c1460db2428 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:52.059404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1129/2261] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:32:51 2022] POST /identity/v3/users => generated 309 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:32:52.065341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d81f-4607-486c-ba3e-4483864cba6b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:52.076861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d81f-4607-486c-ba3e-4483864cba6b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:52.081840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eb533-959c-4830-a772-e5d392bed7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:52.082484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb533-959c-4830-a772-e5d392bed7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:52.082749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb533-959c-4830-a772-e5d392bed7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:52.083026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb533-959c-4830-a772-e5d392bed7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:52.083736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987eb533-959c-4830-a772-e5d392bed7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:52.085415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987eb533-959c-4830-a772-e5d392bed7f3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:52.096453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1133/2262] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:32:52.101230 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba80d3-761c-4b49-b880-4c1460db2428 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:52.116783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba80d3-761c-4b49-b880-4c1460db2428 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:52.122603 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c463-0e07-44a8-bf34-8fdd36927cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:52.123315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c463-0e07-44a8-bf34-8fdd36927cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:52.123572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c463-0e07-44a8-bf34-8fdd36927cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:52.123841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c463-0e07-44a8-bf34-8fdd36927cd4 admin admin] PATH_INFO: `/v3/projects/e37b2dcc616e4e718d8660e6d8abbea4/users/e633a9f54de14dfda6f4e8104aa81e88/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:52.139943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5c463-0e07-44a8-bf34-8fdd36927cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37b2dcc616e4e718d8660e6d8abbea4, user_id=e633a9f54de14dfda6f4e8104aa81e88, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:52.142671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5c463-0e07-44a8-bf34-8fdd36927cd4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:52.159386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1130/2263] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:32:52 2022] PUT /identity/v3/projects/e37b2dcc616e4e718d8660e6d8abbea4/users/e633a9f54de14dfda6f4e8104aa81e88/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:52.165675 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eb533-959c-4830-a772-e5d392bed7f3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:52.179695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eb533-959c-4830-a772-e5d392bed7f3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:52.237684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7692aa-fbef-4ac6-874c-89f4db758422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:52.238312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7692aa-fbef-4ac6-874c-89f4db758422 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:52.238590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7692aa-fbef-4ac6-874c-89f4db758422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:52.238884 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7692aa-fbef-4ac6-874c-89f4db758422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:52.239580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7692aa-fbef-4ac6-874c-89f4db758422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:52.241214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7692aa-fbef-4ac6-874c-89f4db758422 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:52.252060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1134/2264] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:32:52.258213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c463-0e07-44a8-bf34-8fdd36927cd4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:52.269558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c463-0e07-44a8-bf34-8fdd36927cd4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:52.274618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa3811-17c0-47c7-9668-f52aa1fa88bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:52.275303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa3811-17c0-47c7-9668-f52aa1fa88bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:52.275612 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa3811-17c0-47c7-9668-f52aa1fa88bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:52.275888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa3811-17c0-47c7-9668-f52aa1fa88bf admin admin] PATH_INFO: `/v3/projects/e37b2dcc616e4e718d8660e6d8abbea4/users/e633a9f54de14dfda6f4e8104aa81e88/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:52.277953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa3811-17c0-47c7-9668-f52aa1fa88bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37b2dcc616e4e718d8660e6d8abbea4, user_id=e633a9f54de14dfda6f4e8104aa81e88, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:52.280724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa3811-17c0-47c7-9668-f52aa1fa88bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:52.292229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1131/2265] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:32:52 2022] PUT /identity/v3/projects/e37b2dcc616e4e718d8660e6d8abbea4/users/e633a9f54de14dfda6f4e8104aa81e88/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:32:52.302906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb76c0-f0f9-402b-81bc-40846b11fc99 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:52.303193 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb76c0-f0f9-402b-81bc-40846b11fc99 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:52.303473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb76c0-f0f9-402b-81bc-40846b11fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:52.342753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-91bb76c0-f0f9-402b-81bc-40846b11fc99 None None] MFA Rules not processed for user `e633a9f54de14dfda6f4e8104aa81e88`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:52.343893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-91bb76c0-f0f9-402b-81bc-40846b11fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:52.356691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:52.421454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1135/2266] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:52.437874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa3811-17c0-47c7-9668-f52aa1fa88bf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:52.440763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e4fa3811-17c0-47c7-9668-f52aa1fa88bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:52.510122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa3811-17c0-47c7-9668-f52aa1fa88bf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:52.514222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b5885-5661-4096-8119-c1d2fa1cca3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:52.514823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b5885-5661-4096-8119-c1d2fa1cca3a service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:52.515103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b5885-5661-4096-8119-c1d2fa1cca3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:52.515378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b5885-5661-4096-8119-c1d2fa1cca3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:52.525891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b5885-5661-4096-8119-c1d2fa1cca3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:52.527343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b5885-5661-4096-8119-c1d2fa1cca3a service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:52.540106 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1132/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:32:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:32:52.708343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb76c0-f0f9-402b-81bc-40846b11fc99 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:52.771923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb76c0-f0f9-402b-81bc-40846b11fc99 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:52.777185 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:52.777936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:52.778359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:52.778592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] PATH_INFO: `/v3/users/a3d7085a3bb140d79887a711a8314638` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:52.779978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d7085a3bb140d79887a711a8314638)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:52.782067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:52.835723 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d7085a3bb140d79887a711a8314638'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:52.836416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d7085a3bb140d79887a711a8314638'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:52.837048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d7085a3bb140d79887a711a8314638'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:52.850700 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d7085a3bb140d79887a711a8314638'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:52.859060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d7085a3bb140d79887a711a8314638'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:52.874009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1136/2268] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:32:52 2022] DELETE /identity/v3/users/a3d7085a3bb140d79887a711a8314638 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:52.878942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee041-5757-4afa-bba1-9ab252bb6f33 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:52.879333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee041-5757-4afa-bba1-9ab252bb6f33 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:52.879674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee041-5757-4afa-bba1-9ab252bb6f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:52.901003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-882ee041-5757-4afa-bba1-9ab252bb6f33 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:52.902151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-882ee041-5757-4afa-bba1-9ab252bb6f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:52.978793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1133/2269] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:52.989225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:52.990872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:53.029293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:53.058747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d7b6-546c-4a44-858d-4d7b5f803074 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:53.062806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d21bbf-559c-4df5-a59b-509e27673425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:53.063536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d21bbf-559c-4df5-a59b-509e27673425 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:53.063885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d21bbf-559c-4df5-a59b-509e27673425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:53.064221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d21bbf-559c-4df5-a59b-509e27673425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:53.074149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d21bbf-559c-4df5-a59b-509e27673425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:53.075701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d21bbf-559c-4df5-a59b-509e27673425 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:53.086065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1137/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:32:53.365973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee041-5757-4afa-bba1-9ab252bb6f33 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:53.367677 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-882ee041-5757-4afa-bba1-9ab252bb6f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:53.381643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee041-5757-4afa-bba1-9ab252bb6f33 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:53.388505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:53.389346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:53.389757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:53.390132 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] PATH_INFO: `/v3/projects/0f23fdea15f64b148a27d14b42957ed5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:53.391471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f23fdea15f64b148a27d14b42957ed5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:53.393803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:53.417365 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:53.451904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f23fdea15f64b148a27d14b42957ed5', 'request_id': 'req-8012508d-7b90-478d-8cdd-15f02022595e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.460346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f23fdea15f64b148a27d14b42957ed5', 'request_id': 'req-8012508d-7b90-478d-8cdd-15f02022595e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.466189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f23fdea15f64b148a27d14b42957ed5', 'request_id': 'req-8012508d-7b90-478d-8cdd-15f02022595e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.477893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] The token cache is being invalidate because project 0f23fdea15f64b148a27d14b42957ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:32:53.478298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.479039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.480962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1134/2271] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:32:53 2022] DELETE /identity/v3/projects/0f23fdea15f64b148a27d14b42957ed5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:53.484785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d21bbf-559c-4df5-a59b-509e27673425 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:53.494602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d21bbf-559c-4df5-a59b-509e27673425 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:53.554812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:53.555474 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:53.555755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:53.556038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] PATH_INFO: `/v3/users/e633a9f54de14dfda6f4e8104aa81e88` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:53.557225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e633a9f54de14dfda6f4e8104aa81e88)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:53.559198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:53.608088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e633a9f54de14dfda6f4e8104aa81e88'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.608810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e633a9f54de14dfda6f4e8104aa81e88'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.609484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e633a9f54de14dfda6f4e8104aa81e88'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.621678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e633a9f54de14dfda6f4e8104aa81e88'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.630665 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b78f68d-0349-437e-9c6f-237e01e8d9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e633a9f54de14dfda6f4e8104aa81e88'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:53.643950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1138/2272] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:32:53 2022] DELETE /identity/v3/users/e633a9f54de14dfda6f4e8104aa81e88 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:32:53.943840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:53.945658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:53.960364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012508d-7b90-478d-8cdd-15f02022595e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:54.026209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:54.027059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.027417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.027761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] PATH_INFO: `/v3/projects/e37b2dcc616e4e718d8660e6d8abbea4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.029099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37b2dcc616e4e718d8660e6d8abbea4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:54.031167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:54.119472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37b2dcc616e4e718d8660e6d8abbea4', 'request_id': 'req-397580f9-5d8d-404b-8a58-c746d69333e3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:54.133070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37b2dcc616e4e718d8660e6d8abbea4', 'request_id': 'req-397580f9-5d8d-404b-8a58-c746d69333e3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:54.139909 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37b2dcc616e4e718d8660e6d8abbea4', 'request_id': 'req-397580f9-5d8d-404b-8a58-c746d69333e3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:54.153733 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] The token cache is being invalidate because project e37b2dcc616e4e718d8660e6d8abbea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:32:54.154061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:54.154773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-397580f9-5d8d-404b-8a58-c746d69333e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:32:54.156721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1135/2273] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:32:53 2022] DELETE /identity/v3/projects/e37b2dcc616e4e718d8660e6d8abbea4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:54.162083 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e9a1-d655-48c3-9502-2fee93155728 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.162579 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e9a1-d655-48c3-9502-2fee93155728 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.162756 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e9a1-d655-48c3-9502-2fee93155728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.184668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3ec0e9a1-d655-48c3-9502-2fee93155728 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:54.185945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3ec0e9a1-d655-48c3-9502-2fee93155728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:54.242643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:54.269331 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1139/2274] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:32:54.276114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741773b-abac-4b4d-8c12-e180319014a8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.276114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741773b-abac-4b4d-8c12-e180319014a8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.276486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741773b-abac-4b4d-8c12-e180319014a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.298859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4741773b-abac-4b4d-8c12-e180319014a8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:54.300103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4741773b-abac-4b4d-8c12-e180319014a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:54.309448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1136/2275] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:54.313764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0e9a1-d655-48c3-9502-2fee93155728 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:54.324738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0e9a1-d655-48c3-9502-2fee93155728 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:54.331766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56fd9-028a-4902-9c88-793b2034473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:54.332761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56fd9-028a-4902-9c88-793b2034473a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.332943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56fd9-028a-4902-9c88-793b2034473a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.333254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56fd9-028a-4902-9c88-793b2034473a admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.334374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c56fd9-028a-4902-9c88-793b2034473a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:32:54.334551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c56fd9-028a-4902-9c88-793b2034473a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:54.336308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c56fd9-028a-4902-9c88-793b2034473a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:54.353333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1140/2276] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:32:54.354818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741773b-abac-4b4d-8c12-e180319014a8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:54.365055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741773b-abac-4b4d-8c12-e180319014a8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:54.370232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf197220-e09f-4602-b9a5-f770d743bde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:54.370806 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf197220-e09f-4602-b9a5-f770d743bde5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.371082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf197220-e09f-4602-b9a5-f770d743bde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.371353 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf197220-e09f-4602-b9a5-f770d743bde5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.372041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf197220-e09f-4602-b9a5-f770d743bde5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:54.374003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf197220-e09f-4602-b9a5-f770d743bde5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:54.405289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1137/2277] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:32:54 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:32:54.409738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56fd9-028a-4902-9c88-793b2034473a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:54.420942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56fd9-028a-4902-9c88-793b2034473a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:54.485892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3224fe-cef8-4378-b305-c356b0aebf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:54.486588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3224fe-cef8-4378-b305-c356b0aebf6c admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.486925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3224fe-cef8-4378-b305-c356b0aebf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.487135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3224fe-cef8-4378-b305-c356b0aebf6c admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.489121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3224fe-cef8-4378-b305-c356b0aebf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:54.490039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3224fe-cef8-4378-b305-c356b0aebf6c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:54.515523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1141/2278] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:32:54 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:32:54.519589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf197220-e09f-4602-b9a5-f770d743bde5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:54.530910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf197220-e09f-4602-b9a5-f770d743bde5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:54.536294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3be5a-ddb8-40bc-a85f-06a22cbba785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:54.537351 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3be5a-ddb8-40bc-a85f-06a22cbba785 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.537841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3be5a-ddb8-40bc-a85f-06a22cbba785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.538317 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3be5a-ddb8-40bc-a85f-06a22cbba785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.539341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3be5a-ddb8-40bc-a85f-06a22cbba785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:54.541151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3be5a-ddb8-40bc-a85f-06a22cbba785 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:54.543088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:54.556418 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1138/2279] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:32:54.560604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3224fe-cef8-4378-b305-c356b0aebf6c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:54.576054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3224fe-cef8-4378-b305-c356b0aebf6c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:54.583028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab64a11-6a64-4359-a1bf-d46c1fc43c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:54.583611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab64a11-6a64-4359-a1bf-d46c1fc43c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.584075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab64a11-6a64-4359-a1bf-d46c1fc43c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.584419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab64a11-6a64-4359-a1bf-d46c1fc43c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.585707 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab64a11-6a64-4359-a1bf-d46c1fc43c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:54.587112 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab64a11-6a64-4359-a1bf-d46c1fc43c5f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:54.599255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1142/2280] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:32:54.603488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3be5a-ddb8-40bc-a85f-06a22cbba785 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:54.614510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3be5a-ddb8-40bc-a85f-06a22cbba785 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:54.619252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851984b2-2373-404c-b1af-fb2ceaa8315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:54.619940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851984b2-2373-404c-b1af-fb2ceaa8315f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.620219 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851984b2-2373-404c-b1af-fb2ceaa8315f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.620731 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851984b2-2373-404c-b1af-fb2ceaa8315f admin admin] PATH_INFO: `/v3/projects/6a368e2b1ae949ccb6a5dfede4e695b4/users/25d8a0d7093b40f381ccee3893168514/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.644457 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851984b2-2373-404c-b1af-fb2ceaa8315f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a368e2b1ae949ccb6a5dfede4e695b4, user_id=25d8a0d7093b40f381ccee3893168514, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:54.647364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851984b2-2373-404c-b1af-fb2ceaa8315f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:54.662220 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1139/2281] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:32:54 2022] PUT /identity/v3/projects/6a368e2b1ae949ccb6a5dfede4e695b4/users/25d8a0d7093b40f381ccee3893168514/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:32:54.674207 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4800f2-c9b5-4980-b254-4e07689a9e4b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.674538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4800f2-c9b5-4980-b254-4e07689a9e4b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.674868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4800f2-c9b5-4980-b254-4e07689a9e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.719446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fb4800f2-c9b5-4980-b254-4e07689a9e4b None None] MFA Rules not processed for user `25d8a0d7093b40f381ccee3893168514`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:54.721090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fb4800f2-c9b5-4980-b254-4e07689a9e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:54.805245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1143/2282] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:54.809706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851984b2-2373-404c-b1af-fb2ceaa8315f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:54.879035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851984b2-2373-404c-b1af-fb2ceaa8315f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:54.884643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35403cc9-2951-4c0f-acb2-7b9c21b38092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:54.885501 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35403cc9-2951-4c0f-acb2-7b9c21b38092 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.885631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35403cc9-2951-4c0f-acb2-7b9c21b38092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.885975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35403cc9-2951-4c0f-acb2-7b9c21b38092 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.886675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35403cc9-2951-4c0f-acb2-7b9c21b38092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:54.888625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35403cc9-2951-4c0f-acb2-7b9c21b38092 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:54.920286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1140/2283] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:32:54 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:32:54.921657 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4800f2-c9b5-4980-b254-4e07689a9e4b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:54.933120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4800f2-c9b5-4980-b254-4e07689a9e4b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:54.976989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:54.995365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76866191-b4a5-48a2-8f1b-5c11d8a851dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:54.996138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76866191-b4a5-48a2-8f1b-5c11d8a851dc admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:54.996416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76866191-b4a5-48a2-8f1b-5c11d8a851dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:54.996683 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76866191-b4a5-48a2-8f1b-5c11d8a851dc admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:54.997482 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76866191-b4a5-48a2-8f1b-5c11d8a851dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:54.999334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76866191-b4a5-48a2-8f1b-5c11d8a851dc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:55.027031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1144/2284] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:32:54 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:32:55.028413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35403cc9-2951-4c0f-acb2-7b9c21b38092 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:55.040254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35403cc9-2951-4c0f-acb2-7b9c21b38092 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:55.045071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466825e-0e11-46f5-9d34-183023e78967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:55.045721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466825e-0e11-46f5-9d34-183023e78967 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:55.046008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466825e-0e11-46f5-9d34-183023e78967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:55.046291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466825e-0e11-46f5-9d34-183023e78967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:55.047020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466825e-0e11-46f5-9d34-183023e78967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:55.048661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466825e-0e11-46f5-9d34-183023e78967 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:55.060823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1141/2285] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:32:55.065677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76866191-b4a5-48a2-8f1b-5c11d8a851dc admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:55.077786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76866191-b4a5-48a2-8f1b-5c11d8a851dc admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:55.085830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3f30b-dd48-4585-981a-76eb3b3d0675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:55.088037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f30b-dd48-4585-981a-76eb3b3d0675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:55.088230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f30b-dd48-4585-981a-76eb3b3d0675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:55.088496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f30b-dd48-4585-981a-76eb3b3d0675 admin admin] PATH_INFO: `/v3/projects/f04d021ebf454b30bb7a5e47623b8cb8/users/1a599191430248978e36466f37021828/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:55.104561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3f30b-dd48-4585-981a-76eb3b3d0675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04d021ebf454b30bb7a5e47623b8cb8, user_id=1a599191430248978e36466f37021828, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:55.107294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3f30b-dd48-4585-981a-76eb3b3d0675 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:55.122786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1145/2286] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:32:55 2022] PUT /identity/v3/projects/f04d021ebf454b30bb7a5e47623b8cb8/users/1a599191430248978e36466f37021828/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:32:55.126983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466825e-0e11-46f5-9d34-183023e78967 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:55.137550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466825e-0e11-46f5-9d34-183023e78967 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:55.197943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb0af6-fdc9-4d5c-b5b8-ec84f76df750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:55.198599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb0af6-fdc9-4d5c-b5b8-ec84f76df750 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:55.198887 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb0af6-fdc9-4d5c-b5b8-ec84f76df750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:55.199152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb0af6-fdc9-4d5c-b5b8-ec84f76df750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:55.199870 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb0af6-fdc9-4d5c-b5b8-ec84f76df750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:55.201550 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb0af6-fdc9-4d5c-b5b8-ec84f76df750 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:55.214732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1142/2287] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:32:55.219117 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3f30b-dd48-4585-981a-76eb3b3d0675 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:55.231011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3f30b-dd48-4585-981a-76eb3b3d0675 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:55.236650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1af34e-cdeb-44ef-9aea-accba50128d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:55.237391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1af34e-cdeb-44ef-9aea-accba50128d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:55.237673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1af34e-cdeb-44ef-9aea-accba50128d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:55.237947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1af34e-cdeb-44ef-9aea-accba50128d3 admin admin] PATH_INFO: `/v3/projects/f04d021ebf454b30bb7a5e47623b8cb8/users/1a599191430248978e36466f37021828/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:55.240063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1af34e-cdeb-44ef-9aea-accba50128d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04d021ebf454b30bb7a5e47623b8cb8, user_id=1a599191430248978e36466f37021828, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:55.242901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1af34e-cdeb-44ef-9aea-accba50128d3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:55.254524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1146/2288] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:32:55 2022] PUT /identity/v3/projects/f04d021ebf454b30bb7a5e47623b8cb8/users/1a599191430248978e36466f37021828/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:32:55.266128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aa8cb-14e5-474c-863d-f72923f177b4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:55.266458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aa8cb-14e5-474c-863d-f72923f177b4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:55.266684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aa8cb-14e5-474c-863d-f72923f177b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:55.298390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c92aa8cb-14e5-474c-863d-f72923f177b4 None None] MFA Rules not processed for user `1a599191430248978e36466f37021828`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:32:55.300075 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c92aa8cb-14e5-474c-863d-f72923f177b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:55.337714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:32:55.379539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1143/2289] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:32:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:32:55.389933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1af34e-cdeb-44ef-9aea-accba50128d3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:55.391674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5f1af34e-cdeb-44ef-9aea-accba50128d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:32:55.454181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1af34e-cdeb-44ef-9aea-accba50128d3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:55.458090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369800b-483b-4eb3-8380-f385b0e06e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:55.458718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369800b-483b-4eb3-8380-f385b0e06e16 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:55.459298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369800b-483b-4eb3-8380-f385b0e06e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:55.459298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369800b-483b-4eb3-8380-f385b0e06e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:55.468697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369800b-483b-4eb3-8380-f385b0e06e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:55.470167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369800b-483b-4eb3-8380-f385b0e06e16 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:55.479755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1147/2290] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:32:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:32:55.564858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aa8cb-14e5-474c-863d-f72923f177b4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:32:55.575794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aa8cb-14e5-474c-863d-f72923f177b4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:32:55.580521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cdb57-3d86-4df9-80e1-1b9554a2dfc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:32:55.581144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cdb57-3d86-4df9-80e1-1b9554a2dfc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:32:55.581487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cdb57-3d86-4df9-80e1-1b9554a2dfc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:32:55.582165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cdb57-3d86-4df9-80e1-1b9554a2dfc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:32:55.653151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cdb57-3d86-4df9-80e1-1b9554a2dfc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:32:55.654632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cdb57-3d86-4df9-80e1-1b9554a2dfc6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:32:55.663640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1144/2291] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:32:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:02.645869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369800b-483b-4eb3-8380-f385b0e06e16 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:02.714360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369800b-483b-4eb3-8380-f385b0e06e16 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:02.719051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:02.719709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:02.719989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:02.720263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] PATH_INFO: `/v3/users/25d8a0d7093b40f381ccee3893168514` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:02.721745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d8a0d7093b40f381ccee3893168514)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:02.723732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:02.771895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:02.777705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d8a0d7093b40f381ccee3893168514'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:02.778423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d8a0d7093b40f381ccee3893168514'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:02.779436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d8a0d7093b40f381ccee3893168514'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:02.792908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d8a0d7093b40f381ccee3893168514'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:02.801618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d8a0d7093b40f381ccee3893168514'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:02.814172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1148/2292] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:02 2022] DELETE /identity/v3/users/25d8a0d7093b40f381ccee3893168514 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:02.818803 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d98dd-5966-4464-8e5d-d9e6e273cea2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:02.819496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d98dd-5966-4464-8e5d-d9e6e273cea2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:02.819496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d98dd-5966-4464-8e5d-d9e6e273cea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:02.840050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a34d98dd-5966-4464-8e5d-d9e6e273cea2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:02.841303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a34d98dd-5966-4464-8e5d-d9e6e273cea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:02.904273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1145/2293] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:02.914916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:02.916390 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:02.982227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93193f92-7584-4207-a213-2452c004daf9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:02.986534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16d3c-9a4f-4180-9f7a-d53a8d6965ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:02.987169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16d3c-9a4f-4180-9f7a-d53a8d6965ac service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:02.987451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16d3c-9a4f-4180-9f7a-d53a8d6965ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:02.987725 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16d3c-9a4f-4180-9f7a-d53a8d6965ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:02.997994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f16d3c-9a4f-4180-9f7a-d53a8d6965ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:02.999453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f16d3c-9a4f-4180-9f7a-d53a8d6965ac service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:03.009559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1149/2294] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:03.302261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d98dd-5966-4464-8e5d-d9e6e273cea2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:03.303816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a34d98dd-5966-4464-8e5d-d9e6e273cea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:03.324029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d98dd-5966-4464-8e5d-d9e6e273cea2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:03.328774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:03.329807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:03.330090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:03.330360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] PATH_INFO: `/v3/projects/6a368e2b1ae949ccb6a5dfede4e695b4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:03.331575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a368e2b1ae949ccb6a5dfede4e695b4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:03.333537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:03.382755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a368e2b1ae949ccb6a5dfede4e695b4', 'request_id': 'req-a2b5f74e-0e04-46c4-893c-d72a6c488243'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.392635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a368e2b1ae949ccb6a5dfede4e695b4', 'request_id': 'req-a2b5f74e-0e04-46c4-893c-d72a6c488243'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.396825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:03.399745 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a368e2b1ae949ccb6a5dfede4e695b4', 'request_id': 'req-a2b5f74e-0e04-46c4-893c-d72a6c488243'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.416308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] The token cache is being invalidate because project 6a368e2b1ae949ccb6a5dfede4e695b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:03.416858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.417699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.419333 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1146/2295] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:03 2022] DELETE /identity/v3/projects/6a368e2b1ae949ccb6a5dfede4e695b4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:03.423450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16d3c-9a4f-4180-9f7a-d53a8d6965ac service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:03.433353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16d3c-9a4f-4180-9f7a-d53a8d6965ac service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:03.494158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:03.494799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:03.495076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:03.495344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] PATH_INFO: `/v3/users/1a599191430248978e36466f37021828` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:03.496534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a599191430248978e36466f37021828)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:03.498520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:03.551746 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a599191430248978e36466f37021828'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.552473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a599191430248978e36466f37021828'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.553130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a599191430248978e36466f37021828'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.564880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:03.566568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a599191430248978e36466f37021828'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.580019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8512346c-95ed-42c8-9796-d4b3a173e2f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a599191430248978e36466f37021828'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:03.599961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1150/2296] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:03 2022] DELETE /identity/v3/users/1a599191430248978e36466f37021828 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:03.911307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:03.913474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:03.936905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5f74e-0e04-46c4-893c-d72a6c488243 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:03.997510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:03.998413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:03.998827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:03.999200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] PATH_INFO: `/v3/projects/f04d021ebf454b30bb7a5e47623b8cb8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.000526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04d021ebf454b30bb7a5e47623b8cb8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:04.002606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:04.059425 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04d021ebf454b30bb7a5e47623b8cb8', 'request_id': 'req-86619fa0-e455-43fd-bef9-5d6557f14213'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:04.071018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04d021ebf454b30bb7a5e47623b8cb8', 'request_id': 'req-86619fa0-e455-43fd-bef9-5d6557f14213'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:04.077576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04d021ebf454b30bb7a5e47623b8cb8', 'request_id': 'req-86619fa0-e455-43fd-bef9-5d6557f14213'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:04.091036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] The token cache is being invalidate because project f04d021ebf454b30bb7a5e47623b8cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:04.091409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:04.092485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86619fa0-e455-43fd-bef9-5d6557f14213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:04.094382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1147/2297] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:03 2022] DELETE /identity/v3/projects/f04d021ebf454b30bb7a5e47623b8cb8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:04.099258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505906b-06ea-40e0-8158-53cd8e6bfc47 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.099751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505906b-06ea-40e0-8158-53cd8e6bfc47 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.100038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505906b-06ea-40e0-8158-53cd8e6bfc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.126531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9505906b-06ea-40e0-8158-53cd8e6bfc47 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:04.127954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9505906b-06ea-40e0-8158-53cd8e6bfc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:04.192737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1151/2298] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:04.200659 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311592-f33c-43a1-b54e-5c598d70eb30 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.200952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311592-f33c-43a1-b54e-5c598d70eb30 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.201228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311592-f33c-43a1-b54e-5c598d70eb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.231881 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b0311592-f33c-43a1-b54e-5c598d70eb30 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:04.239724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b0311592-f33c-43a1-b54e-5c598d70eb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:04.252151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1148/2299] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:04.256583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505906b-06ea-40e0-8158-53cd8e6bfc47 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:04.278099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505906b-06ea-40e0-8158-53cd8e6bfc47 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:04.288600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f755b-0844-451e-845f-573f4c29de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:04.289289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f755b-0844-451e-845f-573f4c29de9c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.289590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f755b-0844-451e-845f-573f4c29de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.289869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f755b-0844-451e-845f-573f4c29de9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.290618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f755b-0844-451e-845f-573f4c29de9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:33:04.290931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f755b-0844-451e-845f-573f4c29de9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:04.292628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f755b-0844-451e-845f-573f4c29de9c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:04.309070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1152/2300] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:33:04.313291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0311592-f33c-43a1-b54e-5c598d70eb30 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:04.329357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0311592-f33c-43a1-b54e-5c598d70eb30 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:04.335132 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39924517-4d2e-4206-b8fa-f0b2e6d39e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:04.336108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39924517-4d2e-4206-b8fa-f0b2e6d39e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.336490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39924517-4d2e-4206-b8fa-f0b2e6d39e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.336863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39924517-4d2e-4206-b8fa-f0b2e6d39e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.337717 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39924517-4d2e-4206-b8fa-f0b2e6d39e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:04.340023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39924517-4d2e-4206-b8fa-f0b2e6d39e4d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:04.392974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1149/2301] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:04 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:33:04.396955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f755b-0844-451e-845f-573f4c29de9c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:04.409322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f755b-0844-451e-845f-573f4c29de9c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:04.494617 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ee611-856d-4f4b-a608-e4efadb837fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:04.495294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ee611-856d-4f4b-a608-e4efadb837fa admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.495570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ee611-856d-4f4b-a608-e4efadb837fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.495841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ee611-856d-4f4b-a608-e4efadb837fa admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.496752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ee611-856d-4f4b-a608-e4efadb837fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:04.499643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ee611-856d-4f4b-a608-e4efadb837fa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:04.538769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1153/2302] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:04 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:04.543156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39924517-4d2e-4206-b8fa-f0b2e6d39e4d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:04.568898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39924517-4d2e-4206-b8fa-f0b2e6d39e4d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:04.578733 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf9e4a-4b95-4d5c-882c-a7bd098952ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:04.578733 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf9e4a-4b95-4d5c-882c-a7bd098952ed admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.580030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf9e4a-4b95-4d5c-882c-a7bd098952ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.580030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf9e4a-4b95-4d5c-882c-a7bd098952ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.580193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf9e4a-4b95-4d5c-882c-a7bd098952ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:04.582956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf9e4a-4b95-4d5c-882c-a7bd098952ed admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:04.607063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1150/2303] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:04.613870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ee611-856d-4f4b-a608-e4efadb837fa admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:04.632193 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ee611-856d-4f4b-a608-e4efadb837fa admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:04.638574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b97e6-9392-4f6b-843b-4d586bcf68d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:04.639740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b97e6-9392-4f6b-843b-4d586bcf68d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.639740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b97e6-9392-4f6b-843b-4d586bcf68d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.640226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b97e6-9392-4f6b-843b-4d586bcf68d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.641120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b97e6-9392-4f6b-843b-4d586bcf68d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:04.644737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b97e6-9392-4f6b-843b-4d586bcf68d8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:04.675877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf9e4a-4b95-4d5c-882c-a7bd098952ed admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:04.676512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1154/2304] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:04.688531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf9e4a-4b95-4d5c-882c-a7bd098952ed admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:04.725878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204757c-c40e-4736-9cbf-8880c8b96bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:04.726821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204757c-c40e-4736-9cbf-8880c8b96bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.727488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204757c-c40e-4736-9cbf-8880c8b96bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.727945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204757c-c40e-4736-9cbf-8880c8b96bc0 admin admin] PATH_INFO: `/v3/projects/f1930b17c6ab45dcbfff340e13b6a369/users/a6b0e037d6274190a3cda37ddbff265b/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.746018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204757c-c40e-4736-9cbf-8880c8b96bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1930b17c6ab45dcbfff340e13b6a369, user_id=a6b0e037d6274190a3cda37ddbff265b, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:04.749047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204757c-c40e-4736-9cbf-8880c8b96bc0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:04.769510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1151/2305] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:04 2022] PUT /identity/v3/projects/f1930b17c6ab45dcbfff340e13b6a369/users/a6b0e037d6274190a3cda37ddbff265b/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:04.779992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2d8a-b76d-4427-b73b-f85dd47388d9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.780279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2d8a-b76d-4427-b73b-f85dd47388d9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.780552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2d8a-b76d-4427-b73b-f85dd47388d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.814951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5fbd2d8a-b76d-4427-b73b-f85dd47388d9 None None] MFA Rules not processed for user `a6b0e037d6274190a3cda37ddbff265b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:04.816927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5fbd2d8a-b76d-4427-b73b-f85dd47388d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:04.864026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:04.904787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1155/2306] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:04.909480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204757c-c40e-4736-9cbf-8880c8b96bc0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:04.928837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:04.984157 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204757c-c40e-4736-9cbf-8880c8b96bc0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:04.989557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c79b4-68b7-441f-9fd8-ebbd48752b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:04.990282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c79b4-68b7-441f-9fd8-ebbd48752b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:04.990808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c79b4-68b7-441f-9fd8-ebbd48752b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:04.990949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c79b4-68b7-441f-9fd8-ebbd48752b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:04.991747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c79b4-68b7-441f-9fd8-ebbd48752b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:04.993788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c79b4-68b7-441f-9fd8-ebbd48752b3d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:05.023466 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1152/2307] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:04 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:05.027742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd2d8a-b76d-4427-b73b-f85dd47388d9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:05.042188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd2d8a-b76d-4427-b73b-f85dd47388d9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:05.108152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbc2bc-0461-4206-8d28-d069f0493b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:05.108872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbc2bc-0461-4206-8d28-d069f0493b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:05.109164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbc2bc-0461-4206-8d28-d069f0493b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:05.109473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbc2bc-0461-4206-8d28-d069f0493b48 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:05.110164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbc2bc-0461-4206-8d28-d069f0493b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:05.112570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbc2bc-0461-4206-8d28-d069f0493b48 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:05.140573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1156/2308] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:05 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:05.142039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c79b4-68b7-441f-9fd8-ebbd48752b3d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:05.154318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c79b4-68b7-441f-9fd8-ebbd48752b3d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:05.159408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e34c2-d8b0-488a-beef-da4ce2e1d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:05.160237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e34c2-d8b0-488a-beef-da4ce2e1d535 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:05.160614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e34c2-d8b0-488a-beef-da4ce2e1d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:05.160986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e34c2-d8b0-488a-beef-da4ce2e1d535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:05.161948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e34c2-d8b0-488a-beef-da4ce2e1d535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:05.163762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e34c2-d8b0-488a-beef-da4ce2e1d535 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:05.178191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1153/2309] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:05.182582 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbc2bc-0461-4206-8d28-d069f0493b48 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:05.195904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbc2bc-0461-4206-8d28-d069f0493b48 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:05.204641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c34f1-63dd-41fa-a92e-ffeb679c612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:05.206148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c34f1-63dd-41fa-a92e-ffeb679c612b admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:05.208715 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c34f1-63dd-41fa-a92e-ffeb679c612b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:05.209034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c34f1-63dd-41fa-a92e-ffeb679c612b admin admin] PATH_INFO: `/v3/projects/c9c8b2c06c8243e885c79da2d4659cbc/users/51f534081c58455c95807e52ba10b3e1/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:05.227595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c34f1-63dd-41fa-a92e-ffeb679c612b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c8b2c06c8243e885c79da2d4659cbc, user_id=51f534081c58455c95807e52ba10b3e1, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:05.230814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c34f1-63dd-41fa-a92e-ffeb679c612b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:05.248263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1157/2310] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:05 2022] PUT /identity/v3/projects/c9c8b2c06c8243e885c79da2d4659cbc/users/51f534081c58455c95807e52ba10b3e1/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:05.252779 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e34c2-d8b0-488a-beef-da4ce2e1d535 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:05.264554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e34c2-d8b0-488a-beef-da4ce2e1d535 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:05.341458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50398356-c4f7-4e46-98b0-4978a8785771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:05.342103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50398356-c4f7-4e46-98b0-4978a8785771 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:05.342377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50398356-c4f7-4e46-98b0-4978a8785771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:05.342647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50398356-c4f7-4e46-98b0-4978a8785771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:05.343362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50398356-c4f7-4e46-98b0-4978a8785771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:05.345115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50398356-c4f7-4e46-98b0-4978a8785771 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:05.356636 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1154/2311] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:05.360121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c34f1-63dd-41fa-a92e-ffeb679c612b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:05.371528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c34f1-63dd-41fa-a92e-ffeb679c612b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:05.376506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386ba3-cdb8-4bbb-97cf-6a76a64fd33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:05.377198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386ba3-cdb8-4bbb-97cf-6a76a64fd33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:05.377794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386ba3-cdb8-4bbb-97cf-6a76a64fd33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:05.378073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386ba3-cdb8-4bbb-97cf-6a76a64fd33a admin admin] PATH_INFO: `/v3/projects/c9c8b2c06c8243e885c79da2d4659cbc/users/51f534081c58455c95807e52ba10b3e1/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:05.380313 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7386ba3-cdb8-4bbb-97cf-6a76a64fd33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c8b2c06c8243e885c79da2d4659cbc, user_id=51f534081c58455c95807e52ba10b3e1, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:05.383123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7386ba3-cdb8-4bbb-97cf-6a76a64fd33a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:05.395132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1158/2312] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:05 2022] PUT /identity/v3/projects/c9c8b2c06c8243e885c79da2d4659cbc/users/51f534081c58455c95807e52ba10b3e1/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:05.406804 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8256b-83ba-44df-8e1e-4bd38d8c0267 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:05.407091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8256b-83ba-44df-8e1e-4bd38d8c0267 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:05.407368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8256b-83ba-44df-8e1e-4bd38d8c0267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:05.437493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-18f8256b-83ba-44df-8e1e-4bd38d8c0267 None None] MFA Rules not processed for user `51f534081c58455c95807e52ba10b3e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:05.438772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-18f8256b-83ba-44df-8e1e-4bd38d8c0267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:05.512218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1155/2313] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:05.524699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386ba3-cdb8-4bbb-97cf-6a76a64fd33a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:05.526684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c7386ba3-cdb8-4bbb-97cf-6a76a64fd33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:05.591074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386ba3-cdb8-4bbb-97cf-6a76a64fd33a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:05.594850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ddd91-0cb4-48d4-8d17-5582b5425f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:05.595481 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ddd91-0cb4-48d4-8d17-5582b5425f42 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:05.595763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ddd91-0cb4-48d4-8d17-5582b5425f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:05.596039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ddd91-0cb4-48d4-8d17-5582b5425f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:05.606127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ddd91-0cb4-48d4-8d17-5582b5425f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:05.607501 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ddd91-0cb4-48d4-8d17-5582b5425f42 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:05.619901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1159/2314] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:05.680559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8256b-83ba-44df-8e1e-4bd38d8c0267 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:05.682705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-18f8256b-83ba-44df-8e1e-4bd38d8c0267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:05.699235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8256b-83ba-44df-8e1e-4bd38d8c0267 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:05.705019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cc73a-3576-4d9c-9686-40bac77cf1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:05.706124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cc73a-3576-4d9c-9686-40bac77cf1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:05.706461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cc73a-3576-4d9c-9686-40bac77cf1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:05.706745 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cc73a-3576-4d9c-9686-40bac77cf1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:05.721503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:05.781170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cc73a-3576-4d9c-9686-40bac77cf1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:05.782665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cc73a-3576-4d9c-9686-40bac77cf1c8 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:05.793729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1156/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:09.283049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ddd91-0cb4-48d4-8d17-5582b5425f42 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:09.318704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:09.355336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ddd91-0cb4-48d4-8d17-5582b5425f42 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:09.360374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:09.361034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:09.361372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:09.361638 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] PATH_INFO: `/v3/users/a6b0e037d6274190a3cda37ddbff265b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:09.362845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b0e037d6274190a3cda37ddbff265b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:09.364808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:09.416927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b0e037d6274190a3cda37ddbff265b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:09.417618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b0e037d6274190a3cda37ddbff265b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:09.418222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b0e037d6274190a3cda37ddbff265b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:09.432339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b0e037d6274190a3cda37ddbff265b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:09.439733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b0e037d6274190a3cda37ddbff265b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:09.458981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1160/2316] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:09 2022] DELETE /identity/v3/users/a6b0e037d6274190a3cda37ddbff265b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:09.463543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53525cda-1dd4-4439-9ca5-ccc7adae257d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:09.464017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53525cda-1dd4-4439-9ca5-ccc7adae257d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:09.464222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53525cda-1dd4-4439-9ca5-ccc7adae257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:09.484165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-53525cda-1dd4-4439-9ca5-ccc7adae257d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:09.485543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-53525cda-1dd4-4439-9ca5-ccc7adae257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:09.548793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1157/2317] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:09.558971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:09.560408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:09.625655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc81f08-f157-4a96-ab89-1bc6ec09eb6c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:09.630076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440ba15-4589-4581-bbdb-f820d91830ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:09.630723 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440ba15-4589-4581-bbdb-f820d91830ae service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:09.631006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440ba15-4589-4581-bbdb-f820d91830ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:09.631273 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440ba15-4589-4581-bbdb-f820d91830ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:09.641595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440ba15-4589-4581-bbdb-f820d91830ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:09.643379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440ba15-4589-4581-bbdb-f820d91830ae service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:09.653677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1161/2318] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:33:09.998123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53525cda-1dd4-4439-9ca5-ccc7adae257d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:09.999725 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-53525cda-1dd4-4439-9ca5-ccc7adae257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:10.012044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53525cda-1dd4-4439-9ca5-ccc7adae257d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:10.017867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:10.018382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:10.018562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:10.018810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] PATH_INFO: `/v3/projects/f1930b17c6ab45dcbfff340e13b6a369` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:10.020108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1930b17c6ab45dcbfff340e13b6a369)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:10.022107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:10.083716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1930b17c6ab45dcbfff340e13b6a369', 'request_id': 'req-af8cd444-f7a4-4fe2-8543-418fc204f1e6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.093010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1930b17c6ab45dcbfff340e13b6a369', 'request_id': 'req-af8cd444-f7a4-4fe2-8543-418fc204f1e6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.099339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1930b17c6ab45dcbfff340e13b6a369', 'request_id': 'req-af8cd444-f7a4-4fe2-8543-418fc204f1e6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.112182 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] The token cache is being invalidate because project f1930b17c6ab45dcbfff340e13b6a369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:10.112478 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.113241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.114826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1158/2319] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:09 2022] DELETE /identity/v3/projects/f1930b17c6ab45dcbfff340e13b6a369 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:10.119144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440ba15-4589-4581-bbdb-f820d91830ae service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:10.129300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440ba15-4589-4581-bbdb-f820d91830ae service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:10.185864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:10.198696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:10.199429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:10.199731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:10.200227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] PATH_INFO: `/v3/users/51f534081c58455c95807e52ba10b3e1` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:10.201800 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f534081c58455c95807e52ba10b3e1)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:10.203751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:10.253988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f534081c58455c95807e52ba10b3e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.254651 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f534081c58455c95807e52ba10b3e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.255266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f534081c58455c95807e52ba10b3e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.267351 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f534081c58455c95807e52ba10b3e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.275764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a43876a6-3229-4be5-a88d-fcc01916897c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f534081c58455c95807e52ba10b3e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.288373 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1162/2320] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:10 2022] DELETE /identity/v3/users/51f534081c58455c95807e52ba10b3e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:10.581534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:10.583790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:10.601221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cd444-f7a4-4fe2-8543-418fc204f1e6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:10.656480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:10.695121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:10.696102 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:10.696533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:10.697352 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] PATH_INFO: `/v3/projects/c9c8b2c06c8243e885c79da2d4659cbc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:10.699033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c8b2c06c8243e885c79da2d4659cbc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:10.700962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:10.760240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c8b2c06c8243e885c79da2d4659cbc', 'request_id': 'req-31763f13-2e7b-4b35-9d76-a2863e49a7c7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.768957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c8b2c06c8243e885c79da2d4659cbc', 'request_id': 'req-31763f13-2e7b-4b35-9d76-a2863e49a7c7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.774727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c8b2c06c8243e885c79da2d4659cbc', 'request_id': 'req-31763f13-2e7b-4b35-9d76-a2863e49a7c7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.786843 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] The token cache is being invalidate because project c9c8b2c06c8243e885c79da2d4659cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:10.787063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.787713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31763f13-2e7b-4b35-9d76-a2863e49a7c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:10.789668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1159/2321] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:10 2022] DELETE /identity/v3/projects/c9c8b2c06c8243e885c79da2d4659cbc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:10.795030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b6d8-48e5-4fa3-838e-4019265f81e5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:10.795350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b6d8-48e5-4fa3-838e-4019265f81e5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:10.795660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b6d8-48e5-4fa3-838e-4019265f81e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:10.816210 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6614b6d8-48e5-4fa3-838e-4019265f81e5 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:10.817502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6614b6d8-48e5-4fa3-838e-4019265f81e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:10.880763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1163/2322] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:33:10.888906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14d0c-f92a-4819-8f83-9bd3e4f9e6b5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:10.889192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14d0c-f92a-4819-8f83-9bd3e4f9e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:10.889521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14d0c-f92a-4819-8f83-9bd3e4f9e6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:10.909751 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7da14d0c-f92a-4819-8f83-9bd3e4f9e6b5 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:10.910988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7da14d0c-f92a-4819-8f83-9bd3e4f9e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:10.919465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1160/2323] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:10.923861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b6d8-48e5-4fa3-838e-4019265f81e5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:10.933810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b6d8-48e5-4fa3-838e-4019265f81e5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:10.938752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4ad7f-7f24-45af-856e-38731e9a888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:10.939384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4ad7f-7f24-45af-856e-38731e9a888f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:10.939661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4ad7f-7f24-45af-856e-38731e9a888f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:10.939928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4ad7f-7f24-45af-856e-38731e9a888f admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:10.940632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4ad7f-7f24-45af-856e-38731e9a888f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:33:10.940939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4ad7f-7f24-45af-856e-38731e9a888f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:10.942598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4ad7f-7f24-45af-856e-38731e9a888f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:10.955946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1164/2324] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:33:10.960453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da14d0c-f92a-4819-8f83-9bd3e4f9e6b5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:10.970381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da14d0c-f92a-4819-8f83-9bd3e4f9e6b5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:10.975871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540a938-1113-46ae-8b78-ca813b1d3604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:10.976647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540a938-1113-46ae-8b78-ca813b1d3604 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:10.977045 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540a938-1113-46ae-8b78-ca813b1d3604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:10.977197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540a938-1113-46ae-8b78-ca813b1d3604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:10.977931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540a938-1113-46ae-8b78-ca813b1d3604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:10.979906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540a938-1113-46ae-8b78-ca813b1d3604 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:11.015069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1161/2325] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:10 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:33:11.020208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4ad7f-7f24-45af-856e-38731e9a888f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:11.035391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4ad7f-7f24-45af-856e-38731e9a888f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:11.106913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028b8bc-be61-480d-b846-deefed1372c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:11.107930 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028b8bc-be61-480d-b846-deefed1372c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.108054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028b8bc-be61-480d-b846-deefed1372c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.108457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028b8bc-be61-480d-b846-deefed1372c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.109249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028b8bc-be61-480d-b846-deefed1372c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:11.111785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028b8bc-be61-480d-b846-deefed1372c7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:11.122132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:11.145864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1165/2326] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:11 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:11.150387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540a938-1113-46ae-8b78-ca813b1d3604 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:11.161846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540a938-1113-46ae-8b78-ca813b1d3604 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:11.167233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b7956-48af-41c7-89a2-fd0ab72d2b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:11.167921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7956-48af-41c7-89a2-fd0ab72d2b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.168686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7956-48af-41c7-89a2-fd0ab72d2b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.168686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7956-48af-41c7-89a2-fd0ab72d2b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.169197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b7956-48af-41c7-89a2-fd0ab72d2b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:11.170922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b7956-48af-41c7-89a2-fd0ab72d2b8c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:11.182904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1162/2327] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:11.189318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028b8bc-be61-480d-b846-deefed1372c7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:11.199653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028b8bc-be61-480d-b846-deefed1372c7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:11.205043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9088dcd-047d-45da-99c2-f6fb9b1e13f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:11.205857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9088dcd-047d-45da-99c2-f6fb9b1e13f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.206143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9088dcd-047d-45da-99c2-f6fb9b1e13f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.207131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9088dcd-047d-45da-99c2-f6fb9b1e13f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.207131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9088dcd-047d-45da-99c2-f6fb9b1e13f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:11.208766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9088dcd-047d-45da-99c2-f6fb9b1e13f2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:11.221594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1166/2328] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:11.226307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b7956-48af-41c7-89a2-fd0ab72d2b8c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:11.234494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9088dcd-047d-45da-99c2-f6fb9b1e13f2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:11.236481 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a9088dcd-047d-45da-99c2-f6fb9b1e13f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:11.237579 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b7956-48af-41c7-89a2-fd0ab72d2b8c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:11.242477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50e2c-0f69-43d8-864f-0bae9923132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:11.243751 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50e2c-0f69-43d8-864f-0bae9923132d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.244036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50e2c-0f69-43d8-864f-0bae9923132d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.244313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50e2c-0f69-43d8-864f-0bae9923132d admin admin] PATH_INFO: `/v3/projects/c25b38541be84f0bb56cf0101642622b/users/6bdb594740274e6e92d2364e1bb6f1ee/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.259316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb50e2c-0f69-43d8-864f-0bae9923132d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25b38541be84f0bb56cf0101642622b, user_id=6bdb594740274e6e92d2364e1bb6f1ee, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:11.262528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb50e2c-0f69-43d8-864f-0bae9923132d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:11.284729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1163/2329] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:11 2022] PUT /identity/v3/projects/c25b38541be84f0bb56cf0101642622b/users/6bdb594740274e6e92d2364e1bb6f1ee/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:11.297649 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5637fd7-f535-432b-99cb-e9fede514f71 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.298414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5637fd7-f535-432b-99cb-e9fede514f71 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.298695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5637fd7-f535-432b-99cb-e9fede514f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.315118 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9088dcd-047d-45da-99c2-f6fb9b1e13f2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:11.327390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f5637fd7-f535-432b-99cb-e9fede514f71 None None] MFA Rules not processed for user `6bdb594740274e6e92d2364e1bb6f1ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:11.328621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5637fd7-f535-432b-99cb-e9fede514f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:11.378727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:11.385628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4650-2b4b-4c88-abad-9253d55dd0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:11.386284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4650-2b4b-4c88-abad-9253d55dd0dc service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.386569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4650-2b4b-4c88-abad-9253d55dd0dc service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.386846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4650-2b4b-4c88-abad-9253d55dd0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.388773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-253d4650-2b4b-4c88-abad-9253d55dd0dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:11.401913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1164/2330] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:33:11.415185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5637fd7-f535-432b-99cb-e9fede514f71 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:11.417345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5637fd7-f535-432b-99cb-e9fede514f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:11.454013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d4650-2b4b-4c88-abad-9253d55dd0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:11.455661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d4650-2b4b-4c88-abad-9253d55dd0dc service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:11.466539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1167/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:11.520342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5637fd7-f535-432b-99cb-e9fede514f71 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:11.530217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359a0b-bc79-4adc-9c7f-6552a98f465b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:11.530891 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359a0b-bc79-4adc-9c7f-6552a98f465b service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.531174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359a0b-bc79-4adc-9c7f-6552a98f465b service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.531441 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359a0b-bc79-4adc-9c7f-6552a98f465b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.541768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3359a0b-bc79-4adc-9c7f-6552a98f465b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:11.543239 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3359a0b-bc79-4adc-9c7f-6552a98f465b service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:11.567939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1165/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:33:11.588938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4650-2b4b-4c88-abad-9253d55dd0dc service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:11.614194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:11.684801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4650-2b4b-4c88-abad-9253d55dd0dc service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:11.689848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:11.690678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.690962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.691238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] PATH_INFO: `/v3/users/6bdb594740274e6e92d2364e1bb6f1ee` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.692743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdb594740274e6e92d2364e1bb6f1ee)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:11.697309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:11.754578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359a0b-bc79-4adc-9c7f-6552a98f465b service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:11.758130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d3359a0b-bc79-4adc-9c7f-6552a98f465b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:11.760857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdb594740274e6e92d2364e1bb6f1ee'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:11.761788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdb594740274e6e92d2364e1bb6f1ee'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:11.762531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdb594740274e6e92d2364e1bb6f1ee'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:11.779013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359a0b-bc79-4adc-9c7f-6552a98f465b service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:11.781668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdb594740274e6e92d2364e1bb6f1ee'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:11.786878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:11.787816 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.788280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.788632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.791678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:11.806048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff74b09a-5d3d-4712-ba6e-2ac5eb709b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdb594740274e6e92d2364e1bb6f1ee'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:11.824906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1168/2333] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:11 2022] DELETE /identity/v3/users/6bdb594740274e6e92d2364e1bb6f1ee => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:11.830354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b93b89-a4dd-4b50-9962-e6b3ed9d0dd5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:11.830794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b93b89-a4dd-4b50-9962-e6b3ed9d0dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:11.831730 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b93b89-a4dd-4b50-9962-e6b3ed9d0dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:11.867677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-16b93b89-a4dd-4b50-9962-e6b3ed9d0dd5 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:11.869724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-16b93b89-a4dd-4b50-9962-e6b3ed9d0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:11.885665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:11.887409 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:11.897530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1166/2334] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:11.946206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1169/2335] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:11.956682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:11.958169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:12.021169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f117a6-86e1-49a7-a4eb-3fce181142f8 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:12.086858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:12.092731 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8205b-3b4d-47e5-a921-55b7bfc01ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:12.093415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8205b-3b4d-47e5-a921-55b7bfc01ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:12.093753 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8205b-3b4d-47e5-a921-55b7bfc01ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:12.094023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8205b-3b4d-47e5-a921-55b7bfc01ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:12.103098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8205b-3b4d-47e5-a921-55b7bfc01ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:12.104561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8205b-3b4d-47e5-a921-55b7bfc01ff5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:12.113795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1167/2336] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:33:12.282975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259fcff-1122-4449-8126-f745267f6663 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:12.283263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259fcff-1122-4449-8126-f745267f6663 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:12.283542 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259fcff-1122-4449-8126-f745267f6663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:12.308555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b259fcff-1122-4449-8126-f745267f6663 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:12.309923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b259fcff-1122-4449-8126-f745267f6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:12.340272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:12.369138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1170/2337] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 26 07:33:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:12.424388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8205b-3b4d-47e5-a921-55b7bfc01ff5 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:12.426123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cec8205b-3b4d-47e5-a921-55b7bfc01ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:12.434024 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259fcff-1122-4449-8126-f745267f6663 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:12.435770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b259fcff-1122-4449-8126-f745267f6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:12.460281 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259fcff-1122-4449-8126-f745267f6663 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:12.466937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:12.467613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:12.467882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:12.468276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] PATH_INFO: `/v3/projects/c25b38541be84f0bb56cf0101642622b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:12.469645 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25b38541be84f0bb56cf0101642622b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:12.471796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:12.500172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8205b-3b4d-47e5-a921-55b7bfc01ff5 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:12.506516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62681426-4cf9-4434-8611-19768741041e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:12.507129 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62681426-4cf9-4434-8611-19768741041e service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:12.507401 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62681426-4cf9-4434-8611-19768741041e service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:12.507916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62681426-4cf9-4434-8611-19768741041e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:12.516781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62681426-4cf9-4434-8611-19768741041e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:12.518640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62681426-4cf9-4434-8611-19768741041e service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:12.520719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25b38541be84f0bb56cf0101642622b', 'request_id': 'req-51ceae86-3a89-4d5b-8f95-c2a56f036c35'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:12.528210 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1168/2338] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:33:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 07:33:12.529986 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25b38541be84f0bb56cf0101642622b', 'request_id': 'req-51ceae86-3a89-4d5b-8f95-c2a56f036c35'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:12.539002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25b38541be84f0bb56cf0101642622b', 'request_id': 'req-51ceae86-3a89-4d5b-8f95-c2a56f036c35'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:12.555348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] The token cache is being invalidate because project c25b38541be84f0bb56cf0101642622b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:12.555640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:12.556334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51ceae86-3a89-4d5b-8f95-c2a56f036c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:12.557965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1171/2339] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:12 2022] DELETE /identity/v3/projects/c25b38541be84f0bb56cf0101642622b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:12.562850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb05b6-3c62-46e4-9ebf-4e18030419f5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:12.563139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb05b6-3c62-46e4-9ebf-4e18030419f5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:12.563416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb05b6-3c62-46e4-9ebf-4e18030419f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:12.585326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-85bb05b6-3c62-46e4-9ebf-4e18030419f5 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:12.586591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-85bb05b6-3c62-46e4-9ebf-4e18030419f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:12.653340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1169/2340] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:12.722292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d13337-497e-481a-aadc-9bcfdd0d2e07 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:12.722524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d13337-497e-481a-aadc-9bcfdd0d2e07 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:12.722829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d13337-497e-481a-aadc-9bcfdd0d2e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:12.744404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b3d13337-497e-481a-aadc-9bcfdd0d2e07 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:12.745792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b3d13337-497e-481a-aadc-9bcfdd0d2e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:12.754522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1172/2341] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:12.761093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb05b6-3c62-46e4-9ebf-4e18030419f5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:12.771716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb05b6-3c62-46e4-9ebf-4e18030419f5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:12.777223 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf553f-b3e6-421a-92c0-8d436eeefeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:12.778391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf553f-b3e6-421a-92c0-8d436eeefeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:12.779130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf553f-b3e6-421a-92c0-8d436eeefeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:12.779559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf553f-b3e6-421a-92c0-8d436eeefeb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:12.780461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf553f-b3e6-421a-92c0-8d436eeefeb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:33:12.780786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf553f-b3e6-421a-92c0-8d436eeefeb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:12.782831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf553f-b3e6-421a-92c0-8d436eeefeb6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:12.799674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1170/2342] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:33:12.804371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d13337-497e-481a-aadc-9bcfdd0d2e07 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:12.814171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d13337-497e-481a-aadc-9bcfdd0d2e07 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:12.818826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ee282-8d71-411e-bbb2-45e0d8214db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:12.819410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ee282-8d71-411e-bbb2-45e0d8214db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:12.819790 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ee282-8d71-411e-bbb2-45e0d8214db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:12.819950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ee282-8d71-411e-bbb2-45e0d8214db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:12.820666 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ee282-8d71-411e-bbb2-45e0d8214db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:12.822971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ee282-8d71-411e-bbb2-45e0d8214db2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:12.852299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1173/2343] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:12 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:33:12.856524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf553f-b3e6-421a-92c0-8d436eeefeb6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:12.867603 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf553f-b3e6-421a-92c0-8d436eeefeb6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:12.945903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52eff0-9b93-4a5b-8ecb-454410b01740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:12.947067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52eff0-9b93-4a5b-8ecb-454410b01740 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:12.947353 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52eff0-9b93-4a5b-8ecb-454410b01740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:12.947631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52eff0-9b93-4a5b-8ecb-454410b01740 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:12.948640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52eff0-9b93-4a5b-8ecb-454410b01740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:12.951173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52eff0-9b93-4a5b-8ecb-454410b01740 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:12.963824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:12.990114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1171/2344] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:12 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:12.994430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ee282-8d71-411e-bbb2-45e0d8214db2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.006198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ee282-8d71-411e-bbb2-45e0d8214db2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.011204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752cfb-1159-46ee-8f7a-69ced9e3be46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.011839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752cfb-1159-46ee-8f7a-69ced9e3be46 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.012253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752cfb-1159-46ee-8f7a-69ced9e3be46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.012533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752cfb-1159-46ee-8f7a-69ced9e3be46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.013240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24752cfb-1159-46ee-8f7a-69ced9e3be46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.015278 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24752cfb-1159-46ee-8f7a-69ced9e3be46 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.026352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1174/2345] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:13.030900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52eff0-9b93-4a5b-8ecb-454410b01740 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.045934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52eff0-9b93-4a5b-8ecb-454410b01740 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.051243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88810715-093f-4118-8ac9-df89404faf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.052782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88810715-093f-4118-8ac9-df89404faf18 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.053097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88810715-093f-4118-8ac9-df89404faf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.053397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88810715-093f-4118-8ac9-df89404faf18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.054096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88810715-093f-4118-8ac9-df89404faf18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.056244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88810715-093f-4118-8ac9-df89404faf18 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.069384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1172/2346] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:33:13.074140 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752cfb-1159-46ee-8f7a-69ced9e3be46 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.086832 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752cfb-1159-46ee-8f7a-69ced9e3be46 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.095156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a18869-598a-4003-b7bf-4670ed77ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.095926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a18869-598a-4003-b7bf-4670ed77ecf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.096268 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a18869-598a-4003-b7bf-4670ed77ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.096606 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a18869-598a-4003-b7bf-4670ed77ecf9 admin admin] PATH_INFO: `/v3/projects/194b2275bd3f41ffb5d2bdc074cc0e0f/users/afd883337a16473f854b80c285f7d38c/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.117485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a18869-598a-4003-b7bf-4670ed77ecf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194b2275bd3f41ffb5d2bdc074cc0e0f, user_id=afd883337a16473f854b80c285f7d38c, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.120134 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a18869-598a-4003-b7bf-4670ed77ecf9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.142003 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1175/2347] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:13 2022] PUT /identity/v3/projects/194b2275bd3f41ffb5d2bdc074cc0e0f/users/afd883337a16473f854b80c285f7d38c/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:33:13.149737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4c953-d159-4c0d-8c8f-e6b51d40bd81 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.150124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4c953-d159-4c0d-8c8f-e6b51d40bd81 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.150489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4c953-d159-4c0d-8c8f-e6b51d40bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.186293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8fe4c953-d159-4c0d-8c8f-e6b51d40bd81 None None] MFA Rules not processed for user `afd883337a16473f854b80c285f7d38c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:13.188383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8fe4c953-d159-4c0d-8c8f-e6b51d40bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:13.279710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1173/2348] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:13.280880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a18869-598a-4003-b7bf-4670ed77ecf9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.370694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:13.377363 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a18869-598a-4003-b7bf-4670ed77ecf9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.384915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d93d7c-ee37-43c7-b5f6-1d44b47e8543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.385905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d93d7c-ee37-43c7-b5f6-1d44b47e8543 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.386258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d93d7c-ee37-43c7-b5f6-1d44b47e8543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.386594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d93d7c-ee37-43c7-b5f6-1d44b47e8543 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.387404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d93d7c-ee37-43c7-b5f6-1d44b47e8543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.390890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d93d7c-ee37-43c7-b5f6-1d44b47e8543 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.427413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1176/2349] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:13 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:33:13.428939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4c953-d159-4c0d-8c8f-e6b51d40bd81 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.442635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4c953-d159-4c0d-8c8f-e6b51d40bd81 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.505032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8d62c-e980-4a5c-ad60-c5c5aa25e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.505694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d62c-e980-4a5c-ad60-c5c5aa25e2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.505977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d62c-e980-4a5c-ad60-c5c5aa25e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.506247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d62c-e980-4a5c-ad60-c5c5aa25e2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.506947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8d62c-e980-4a5c-ad60-c5c5aa25e2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.508919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8d62c-e980-4a5c-ad60-c5c5aa25e2e7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.531537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1174/2350] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:13 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:13.535713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d93d7c-ee37-43c7-b5f6-1d44b47e8543 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.546753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d93d7c-ee37-43c7-b5f6-1d44b47e8543 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.551792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2e60-f27b-4232-980c-e55a063c2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.552498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2e60-f27b-4232-980c-e55a063c2291 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.552801 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2e60-f27b-4232-980c-e55a063c2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.553061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2e60-f27b-4232-980c-e55a063c2291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.553799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b2e60-f27b-4232-980c-e55a063c2291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.555490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b2e60-f27b-4232-980c-e55a063c2291 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.566446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1177/2351] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:33:13.570622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8d62c-e980-4a5c-ad60-c5c5aa25e2e7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.581739 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8d62c-e980-4a5c-ad60-c5c5aa25e2e7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.586645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f448b4-825e-4f6d-8a31-fde404b3006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.587329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f448b4-825e-4f6d-8a31-fde404b3006d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.587609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f448b4-825e-4f6d-8a31-fde404b3006d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.587880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f448b4-825e-4f6d-8a31-fde404b3006d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.588587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f448b4-825e-4f6d-8a31-fde404b3006d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.590230 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f448b4-825e-4f6d-8a31-fde404b3006d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.601169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1175/2352] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:13.605629 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2e60-f27b-4232-980c-e55a063c2291 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.616603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2e60-f27b-4232-980c-e55a063c2291 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.622498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29107-d9f2-46fa-9199-f5e1b81f8505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.623181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29107-d9f2-46fa-9199-f5e1b81f8505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.623462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29107-d9f2-46fa-9199-f5e1b81f8505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.623738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29107-d9f2-46fa-9199-f5e1b81f8505 admin admin] PATH_INFO: `/v3/projects/805a6452931f4ea1a663544ab6b3bd15/users/23c6f747ed0949128b721581cef5cbaf/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.639752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b29107-d9f2-46fa-9199-f5e1b81f8505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805a6452931f4ea1a663544ab6b3bd15, user_id=23c6f747ed0949128b721581cef5cbaf, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.642503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b29107-d9f2-46fa-9199-f5e1b81f8505 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.656946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1178/2353] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:13 2022] PUT /identity/v3/projects/805a6452931f4ea1a663544ab6b3bd15/users/23c6f747ed0949128b721581cef5cbaf/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:13.669151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3067af6-6753-426c-9b1d-0094cf0ce3dc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.669491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3067af6-6753-426c-9b1d-0094cf0ce3dc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.669820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3067af6-6753-426c-9b1d-0094cf0ce3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.705072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f3067af6-6753-426c-9b1d-0094cf0ce3dc None None] MFA Rules not processed for user `23c6f747ed0949128b721581cef5cbaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:13.706396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f3067af6-6753-426c-9b1d-0094cf0ce3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:13.752289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:13.778565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1176/2354] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:13.783590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29107-d9f2-46fa-9199-f5e1b81f8505 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.856905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29107-d9f2-46fa-9199-f5e1b81f8505 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.861513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fbfe6-c059-4bc1-adac-e2825b8e9792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.862151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fbfe6-c059-4bc1-adac-e2825b8e9792 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.862429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fbfe6-c059-4bc1-adac-e2825b8e9792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.862709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fbfe6-c059-4bc1-adac-e2825b8e9792 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.863399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fbfe6-c059-4bc1-adac-e2825b8e9792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.865349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fbfe6-c059-4bc1-adac-e2825b8e9792 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.893818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1179/2355] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:13 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:13.897688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3067af6-6753-426c-9b1d-0094cf0ce3dc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:13.908500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3067af6-6753-426c-9b1d-0094cf0ce3dc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:13.967528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2229ff3-93c9-4dce-9cd5-130a30bd25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:13.968217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2229ff3-93c9-4dce-9cd5-130a30bd25fe admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:13.968506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2229ff3-93c9-4dce-9cd5-130a30bd25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:13.968823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2229ff3-93c9-4dce-9cd5-130a30bd25fe admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:13.969833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2229ff3-93c9-4dce-9cd5-130a30bd25fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:13.971459 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2229ff3-93c9-4dce-9cd5-130a30bd25fe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:13.997154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1177/2356] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:13 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:14.001254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fbfe6-c059-4bc1-adac-e2825b8e9792 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:14.012840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fbfe6-c059-4bc1-adac-e2825b8e9792 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:14.017809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949ac03-573f-4a77-9c26-52e6625452b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:14.018457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949ac03-573f-4a77-9c26-52e6625452b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:14.018735 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949ac03-573f-4a77-9c26-52e6625452b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:14.019008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949ac03-573f-4a77-9c26-52e6625452b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:14.019732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949ac03-573f-4a77-9c26-52e6625452b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:14.021468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949ac03-573f-4a77-9c26-52e6625452b3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:14.037306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1180/2357] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:14.039034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2229ff3-93c9-4dce-9cd5-130a30bd25fe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:14.049958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2229ff3-93c9-4dce-9cd5-130a30bd25fe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:14.055517 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601d72-5c10-4feb-b4d4-830b578c7820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:14.056504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601d72-5c10-4feb-b4d4-830b578c7820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:14.056504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601d72-5c10-4feb-b4d4-830b578c7820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:14.056769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601d72-5c10-4feb-b4d4-830b578c7820 admin admin] PATH_INFO: `/v3/projects/e0cb358856124833a4ee1eb13d1bfe3d/users/519cf50d82c64a818d11930683376a8d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:14.076902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7601d72-5c10-4feb-b4d4-830b578c7820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cb358856124833a4ee1eb13d1bfe3d, user_id=519cf50d82c64a818d11930683376a8d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:14.079622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7601d72-5c10-4feb-b4d4-830b578c7820 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:14.099395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1178/2358] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:14 2022] PUT /identity/v3/projects/e0cb358856124833a4ee1eb13d1bfe3d/users/519cf50d82c64a818d11930683376a8d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:14.100965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949ac03-573f-4a77-9c26-52e6625452b3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:14.112077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949ac03-573f-4a77-9c26-52e6625452b3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:14.198353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92835d-1e0a-4e47-80d4-b8574ef1134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:14.199176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92835d-1e0a-4e47-80d4-b8574ef1134c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:14.199357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92835d-1e0a-4e47-80d4-b8574ef1134c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:14.199668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92835d-1e0a-4e47-80d4-b8574ef1134c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:14.200446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92835d-1e0a-4e47-80d4-b8574ef1134c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:14.202200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92835d-1e0a-4e47-80d4-b8574ef1134c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:14.214271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1181/2359] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:14.218475 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601d72-5c10-4feb-b4d4-830b578c7820 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:14.236515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601d72-5c10-4feb-b4d4-830b578c7820 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:14.241516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc18a1-60dd-4a9f-8b37-cab309214ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:14.242311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc18a1-60dd-4a9f-8b37-cab309214ced admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:14.242582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc18a1-60dd-4a9f-8b37-cab309214ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:14.242876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc18a1-60dd-4a9f-8b37-cab309214ced admin admin] PATH_INFO: `/v3/projects/e0cb358856124833a4ee1eb13d1bfe3d/users/519cf50d82c64a818d11930683376a8d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:14.244945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc18a1-60dd-4a9f-8b37-cab309214ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cb358856124833a4ee1eb13d1bfe3d, user_id=519cf50d82c64a818d11930683376a8d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:14.247682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc18a1-60dd-4a9f-8b37-cab309214ced admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:14.259029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1179/2360] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:14 2022] PUT /identity/v3/projects/e0cb358856124833a4ee1eb13d1bfe3d/users/519cf50d82c64a818d11930683376a8d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:14.270200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78628-934b-4d58-be95-f69169ddff81 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:14.270486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78628-934b-4d58-be95-f69169ddff81 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:14.270764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78628-934b-4d58-be95-f69169ddff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:14.300506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d6c78628-934b-4d58-be95-f69169ddff81 None None] MFA Rules not processed for user `519cf50d82c64a818d11930683376a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:14.301809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d6c78628-934b-4d58-be95-f69169ddff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:14.307085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:14.391541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1182/2361] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:14.416382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc18a1-60dd-4a9f-8b37-cab309214ced admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:14.418320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-99cc18a1-60dd-4a9f-8b37-cab309214ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:14.479056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc18a1-60dd-4a9f-8b37-cab309214ced admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:14.482940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab04cc-ab39-41be-98e0-0c12d852c585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:14.483570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab04cc-ab39-41be-98e0-0c12d852c585 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:14.483852 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab04cc-ab39-41be-98e0-0c12d852c585 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:14.484125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab04cc-ab39-41be-98e0-0c12d852c585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:14.537118 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:14.574422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab04cc-ab39-41be-98e0-0c12d852c585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:14.576122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab04cc-ab39-41be-98e0-0c12d852c585 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:14.611789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1180/2362] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:16.319012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78628-934b-4d58-be95-f69169ddff81 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:16.320640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d6c78628-934b-4d58-be95-f69169ddff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:16.336235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78628-934b-4d58-be95-f69169ddff81 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:16.342159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdad3d-1b0b-4510-b2c5-f57cc0969d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:16.343229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdad3d-1b0b-4510-b2c5-f57cc0969d3d service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:16.343513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdad3d-1b0b-4510-b2c5-f57cc0969d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:16.343786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdad3d-1b0b-4510-b2c5-f57cc0969d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:16.440602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdad3d-1b0b-4510-b2c5-f57cc0969d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:16.442297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdad3d-1b0b-4510-b2c5-f57cc0969d3d service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:16.453762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1183/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:17.061788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab04cc-ab39-41be-98e0-0c12d852c585 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:17.071784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab04cc-ab39-41be-98e0-0c12d852c585 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:17.076076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d7450-5744-4ec6-8bb6-1eecf2ed6bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:17.076944 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d7450-5744-4ec6-8bb6-1eecf2ed6bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:17.077433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d7450-5744-4ec6-8bb6-1eecf2ed6bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:17.077883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d7450-5744-4ec6-8bb6-1eecf2ed6bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:17.088547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d7450-5744-4ec6-8bb6-1eecf2ed6bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:17.090262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d7450-5744-4ec6-8bb6-1eecf2ed6bc7 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:17.111589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1181/2364] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:20.173727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdad3d-1b0b-4510-b2c5-f57cc0969d3d service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:20.176572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-35fdad3d-1b0b-4510-b2c5-f57cc0969d3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:20.260861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdad3d-1b0b-4510-b2c5-f57cc0969d3d service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:20.265529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:20.266318 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:20.266788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:20.267068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] PATH_INFO: `/v3/users/ff7969a7458e4237b4ba807433ca3c3d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:20.268271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7969a7458e4237b4ba807433ca3c3d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:20.270249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:20.326281 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:20.330553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7969a7458e4237b4ba807433ca3c3d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.331404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7969a7458e4237b4ba807433ca3c3d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.332063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7969a7458e4237b4ba807433ca3c3d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.346704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7969a7458e4237b4ba807433ca3c3d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.355329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7969a7458e4237b4ba807433ca3c3d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.369854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1184/2365] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:20 2022] DELETE /identity/v3/users/ff7969a7458e4237b4ba807433ca3c3d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:20.632217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d7450-5744-4ec6-8bb6-1eecf2ed6bc7 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:20.655096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d7450-5744-4ec6-8bb6-1eecf2ed6bc7 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:20.730411 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:20.731159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:20.731521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:20.731971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] PATH_INFO: `/v3/projects/be1b2c42b8b64062828a333827f1c1e6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:20.733780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1b2c42b8b64062828a333827f1c1e6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:20.735924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:20.793079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1b2c42b8b64062828a333827f1c1e6', 'request_id': 'req-baf00a0d-df6f-4099-9597-fd440efbca81'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.804687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1b2c42b8b64062828a333827f1c1e6', 'request_id': 'req-baf00a0d-df6f-4099-9597-fd440efbca81'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.812336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1b2c42b8b64062828a333827f1c1e6', 'request_id': 'req-baf00a0d-df6f-4099-9597-fd440efbca81'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.824438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] The token cache is being invalidate because project be1b2c42b8b64062828a333827f1c1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:20.824720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.825400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-baf00a0d-df6f-4099-9597-fd440efbca81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.826964 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1182/2366] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:20 2022] DELETE /identity/v3/projects/be1b2c42b8b64062828a333827f1c1e6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:20.831014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:20.832500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:20.847839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee48ef-ea8c-434a-bca0-7ff0e38db77e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:20.919065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:20.919744 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:20.920022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:20.920297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] PATH_INFO: `/v3/users/a3662d1d20f246688748796d04d87101` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:20.921527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3662d1d20f246688748796d04d87101)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:20.923471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:20.986065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3662d1d20f246688748796d04d87101'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.987187 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3662d1d20f246688748796d04d87101'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.988315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3662d1d20f246688748796d04d87101'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:20.999611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eec4d-0e26-4964-b83e-b42db6586d16 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:20.999951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eec4d-0e26-4964-b83e-b42db6586d16 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:21.000234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eec4d-0e26-4964-b83e-b42db6586d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:21.005217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3662d1d20f246688748796d04d87101'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.014390 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3662d1d20f246688748796d04d87101'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.022801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eb3eec4d-0e26-4964-b83e-b42db6586d16 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:21.024263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eb3eec4d-0e26-4964-b83e-b42db6586d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:21.031413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1185/2367] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:20 2022] DELETE /identity/v3/users/a3662d1d20f246688748796d04d87101 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:21.089440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1183/2368] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:33:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:33:21.103166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:21.104833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:21.157459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:21.190130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdc4dc-cb4e-45f7-a1e8-b9eaadf0cccb admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:21.196752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807265c4-719e-4bc0-b88c-4d843ab68786 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:21.197514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807265c4-719e-4bc0-b88c-4d843ab68786 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:21.197798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807265c4-719e-4bc0-b88c-4d843ab68786 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:21.198070 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807265c4-719e-4bc0-b88c-4d843ab68786 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:21.229596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eec4d-0e26-4964-b83e-b42db6586d16 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:21.231539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eb3eec4d-0e26-4964-b83e-b42db6586d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:21.259793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eec4d-0e26-4964-b83e-b42db6586d16 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:21.285703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807265c4-719e-4bc0-b88c-4d843ab68786 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:21.288862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:21.291530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807265c4-719e-4bc0-b88c-4d843ab68786 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:21.304672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1186/2369] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:33:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:33:21.305623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807265c4-719e-4bc0-b88c-4d843ab68786 service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:21.307233 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-807265c4-719e-4bc0-b88c-4d843ab68786 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:21.378024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:21.381782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:21.382112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:21.383693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] PATH_INFO: `/v3/projects/3ee663ac013149188c40cc75f216f7c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:21.387527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee663ac013149188c40cc75f216f7c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:21.391019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:21.399574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807265c4-719e-4bc0-b88c-4d843ab68786 service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:21.408507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:21.409522 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:21.410078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:21.410461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] PATH_INFO: `/v3/users/afd883337a16473f854b80c285f7d38c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:21.412312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd883337a16473f854b80c285f7d38c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:21.415703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:21.500217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee663ac013149188c40cc75f216f7c0', 'request_id': 'req-bbc76a32-ddab-4927-a741-7b6a97076987'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.518197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee663ac013149188c40cc75f216f7c0', 'request_id': 'req-bbc76a32-ddab-4927-a741-7b6a97076987'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.521052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd883337a16473f854b80c285f7d38c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.522335 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd883337a16473f854b80c285f7d38c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.523059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd883337a16473f854b80c285f7d38c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.525767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee663ac013149188c40cc75f216f7c0', 'request_id': 'req-bbc76a32-ddab-4927-a741-7b6a97076987'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.540231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd883337a16473f854b80c285f7d38c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.547700 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] The token cache is being invalidate because project 3ee663ac013149188c40cc75f216f7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:21.548152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.549367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc76a32-ddab-4927-a741-7b6a97076987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.552309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd883337a16473f854b80c285f7d38c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:21.553347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1184/2370] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:21 2022] DELETE /identity/v3/projects/3ee663ac013149188c40cc75f216f7c0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:21.579929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:21.587687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1187/2371] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:21 2022] DELETE /identity/v3/users/afd883337a16473f854b80c285f7d38c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:21.593119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6c01-e2fa-4d99-8216-709f5faa1133 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:21.593444 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6c01-e2fa-4d99-8216-709f5faa1133 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:21.593721 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6c01-e2fa-4d99-8216-709f5faa1133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:21.639428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a48a6c01-e2fa-4d99-8216-709f5faa1133 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:21.640868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a48a6c01-e2fa-4d99-8216-709f5faa1133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:21.757000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1185/2372] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:21.768051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:21.769693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:21.901860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3276d-a48f-44fe-8d70-a5e61e877975 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:21.908390 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3cec-c81d-4124-aff6-08292c12a797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:21.909062 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3cec-c81d-4124-aff6-08292c12a797 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:21.909777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3cec-c81d-4124-aff6-08292c12a797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:21.909777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3cec-c81d-4124-aff6-08292c12a797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:21.921236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3cec-c81d-4124-aff6-08292c12a797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:21.922754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3cec-c81d-4124-aff6-08292c12a797 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:21.934551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1188/2373] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:33:22.305555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6c01-e2fa-4d99-8216-709f5faa1133 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:22.307375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a48a6c01-e2fa-4d99-8216-709f5faa1133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:22.326299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6c01-e2fa-4d99-8216-709f5faa1133 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:22.335248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:22.335980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:22.336269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:22.336516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] PATH_INFO: `/v3/projects/194b2275bd3f41ffb5d2bdc074cc0e0f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:22.337777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] RBAC: Authorizing `identity:delete_project(project_id=194b2275bd3f41ffb5d2bdc074cc0e0f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:22.339752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:22.391752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:22.407993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194b2275bd3f41ffb5d2bdc074cc0e0f', 'request_id': 'req-92adebe7-4ed5-46e8-91dd-d5d38036326c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.420848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194b2275bd3f41ffb5d2bdc074cc0e0f', 'request_id': 'req-92adebe7-4ed5-46e8-91dd-d5d38036326c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.427784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194b2275bd3f41ffb5d2bdc074cc0e0f', 'request_id': 'req-92adebe7-4ed5-46e8-91dd-d5d38036326c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.443086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] The token cache is being invalidate because project 194b2275bd3f41ffb5d2bdc074cc0e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:22.443450 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.444201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.446130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1186/2374] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:22 2022] DELETE /identity/v3/projects/194b2275bd3f41ffb5d2bdc074cc0e0f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:22.450931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3cec-c81d-4124-aff6-08292c12a797 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:22.464647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3cec-c81d-4124-aff6-08292c12a797 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:22.555243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:22.556398 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:22.556881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:22.561830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] PATH_INFO: `/v3/users/23c6f747ed0949128b721581cef5cbaf` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:22.563268 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c6f747ed0949128b721581cef5cbaf)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:22.566080 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:22.625916 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c6f747ed0949128b721581cef5cbaf'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.626606 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c6f747ed0949128b721581cef5cbaf'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.627222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c6f747ed0949128b721581cef5cbaf'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.661766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c6f747ed0949128b721581cef5cbaf'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.706933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c6f747ed0949128b721581cef5cbaf'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:22.729989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1189/2375] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:22 2022] DELETE /identity/v3/users/23c6f747ed0949128b721581cef5cbaf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:23.125846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:23.127764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:23.164356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adebe7-4ed5-46e8-91dd-d5d38036326c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:23.235033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:23.250178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:23.250959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:23.250959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] PATH_INFO: `/v3/projects/805a6452931f4ea1a663544ab6b3bd15` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:23.263748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805a6452931f4ea1a663544ab6b3bd15)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:23.267118 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:23.345228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805a6452931f4ea1a663544ab6b3bd15', 'request_id': 'req-4fd98f33-f7d2-4d14-9830-0da2049eeac0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.357090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805a6452931f4ea1a663544ab6b3bd15', 'request_id': 'req-4fd98f33-f7d2-4d14-9830-0da2049eeac0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.364975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805a6452931f4ea1a663544ab6b3bd15', 'request_id': 'req-4fd98f33-f7d2-4d14-9830-0da2049eeac0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.395275 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] The token cache is being invalidate because project 805a6452931f4ea1a663544ab6b3bd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:23.395883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.396839 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.398998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1187/2376] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:23 2022] DELETE /identity/v3/projects/805a6452931f4ea1a663544ab6b3bd15 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:23.404234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:23.404873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:23.422229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c8701-6aba-42f2-a931-1c15c129a67c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:23.446709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:23.524788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:23.526990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:23.527472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:23.528338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] PATH_INFO: `/v3/users/519cf50d82c64a818d11930683376a8d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:23.530097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519cf50d82c64a818d11930683376a8d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:23.533399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:23.612459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519cf50d82c64a818d11930683376a8d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.613344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519cf50d82c64a818d11930683376a8d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.614232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519cf50d82c64a818d11930683376a8d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.651623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519cf50d82c64a818d11930683376a8d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.664959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4647eeed-cd68-4428-92d4-d79ce9c339c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519cf50d82c64a818d11930683376a8d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:23.683169 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1190/2377] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:23 2022] DELETE /identity/v3/users/519cf50d82c64a818d11930683376a8d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:24.181705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:24.183428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:24.202703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98f33-f7d2-4d14-9830-0da2049eeac0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:24.269710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:24.284245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:24.284926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:24.285207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:24.285643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] PATH_INFO: `/v3/projects/e0cb358856124833a4ee1eb13d1bfe3d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:24.287028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0cb358856124833a4ee1eb13d1bfe3d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:24.291710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:24.364412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0cb358856124833a4ee1eb13d1bfe3d', 'request_id': 'req-a5f38b33-4620-43bb-b067-df65142993ff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:24.376229 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0cb358856124833a4ee1eb13d1bfe3d', 'request_id': 'req-a5f38b33-4620-43bb-b067-df65142993ff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:24.386509 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0cb358856124833a4ee1eb13d1bfe3d', 'request_id': 'req-a5f38b33-4620-43bb-b067-df65142993ff'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:24.406995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] The token cache is being invalidate because project e0cb358856124833a4ee1eb13d1bfe3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:24.406995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:24.406995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5f38b33-4620-43bb-b067-df65142993ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:24.411258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1188/2378] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:24 2022] DELETE /identity/v3/projects/e0cb358856124833a4ee1eb13d1bfe3d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:24.413322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b278374-25d5-4fc1-b222-c8283af8c6af None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:24.413679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b278374-25d5-4fc1-b222-c8283af8c6af None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:24.413963 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b278374-25d5-4fc1-b222-c8283af8c6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:24.446738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1b278374-25d5-4fc1-b222-c8283af8c6af None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:24.448437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1b278374-25d5-4fc1-b222-c8283af8c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:24.538065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1191/2379] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:24.546768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a5929-8e56-4c57-b03e-b5b4caa7d5e2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:24.547160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a5929-8e56-4c57-b03e-b5b4caa7d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:24.547526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a5929-8e56-4c57-b03e-b5b4caa7d5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:24.575319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7d6a5929-8e56-4c57-b03e-b5b4caa7d5e2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:24.579711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7d6a5929-8e56-4c57-b03e-b5b4caa7d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:24.592433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1189/2380] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:24.593489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b278374-25d5-4fc1-b222-c8283af8c6af None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:24.606572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b278374-25d5-4fc1-b222-c8283af8c6af None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:24.612811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b8a68-7ee4-4f1a-827d-7a35345cbe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:24.613819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b8a68-7ee4-4f1a-827d-7a35345cbe23 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:24.614293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b8a68-7ee4-4f1a-827d-7a35345cbe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:24.614739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b8a68-7ee4-4f1a-827d-7a35345cbe23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:24.615649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b8a68-7ee4-4f1a-827d-7a35345cbe23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:33:24.616109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b8a68-7ee4-4f1a-827d-7a35345cbe23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:24.618633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b8a68-7ee4-4f1a-827d-7a35345cbe23 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:24.634378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1192/2381] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:33:24.638460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a5929-8e56-4c57-b03e-b5b4caa7d5e2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:24.650137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a5929-8e56-4c57-b03e-b5b4caa7d5e2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:24.655536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abaff7-b53d-4a03-883a-b5633e0bc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:24.656332 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abaff7-b53d-4a03-883a-b5633e0bc80b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:24.656728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abaff7-b53d-4a03-883a-b5633e0bc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:24.657091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abaff7-b53d-4a03-883a-b5633e0bc80b admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:24.657907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abaff7-b53d-4a03-883a-b5633e0bc80b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:24.659957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abaff7-b53d-4a03-883a-b5633e0bc80b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:24.736617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1190/2382] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:24 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:24.740956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b8a68-7ee4-4f1a-827d-7a35345cbe23 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:24.761041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b8a68-7ee4-4f1a-827d-7a35345cbe23 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:24.808347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:24.852931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcdc77-413e-422b-89c9-f92f9710b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:24.854374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcdc77-413e-422b-89c9-f92f9710b7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:24.855192 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcdc77-413e-422b-89c9-f92f9710b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:24.855513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcdc77-413e-422b-89c9-f92f9710b7f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:24.856777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcdc77-413e-422b-89c9-f92f9710b7f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:24.860619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcdc77-413e-422b-89c9-f92f9710b7f6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:24.893360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1193/2383] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:24 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:33:24.896662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abaff7-b53d-4a03-883a-b5633e0bc80b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:24.907933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abaff7-b53d-4a03-883a-b5633e0bc80b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:24.913285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec34f42-eea5-4e36-8466-699a4341e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:24.914115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec34f42-eea5-4e36-8466-699a4341e2cc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:24.914428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec34f42-eea5-4e36-8466-699a4341e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:24.914702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec34f42-eea5-4e36-8466-699a4341e2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:24.915437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec34f42-eea5-4e36-8466-699a4341e2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:24.917019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec34f42-eea5-4e36-8466-699a4341e2cc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:24.929304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1191/2384] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:24.932846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcdc77-413e-422b-89c9-f92f9710b7f6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:24.946781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcdc77-413e-422b-89c9-f92f9710b7f6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:24.951795 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44565ba-4eb1-4d14-be86-2201c80eb3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:24.952421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44565ba-4eb1-4d14-be86-2201c80eb3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:24.952780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44565ba-4eb1-4d14-be86-2201c80eb3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:24.953063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44565ba-4eb1-4d14-be86-2201c80eb3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:24.953836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44565ba-4eb1-4d14-be86-2201c80eb3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:24.955454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44565ba-4eb1-4d14-be86-2201c80eb3ef admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:24.971475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1194/2385] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:24.972176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec34f42-eea5-4e36-8466-699a4341e2cc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:24.983458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec34f42-eea5-4e36-8466-699a4341e2cc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:24.988966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47105f1-cf31-41ec-ade2-2a39c61d2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:24.989690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47105f1-cf31-41ec-ade2-2a39c61d2fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:24.989971 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47105f1-cf31-41ec-ade2-2a39c61d2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:24.990245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47105f1-cf31-41ec-ade2-2a39c61d2fd7 admin admin] PATH_INFO: `/v3/projects/045308cda7a449d7a44d1e84aa7c1a9d/users/02e04f57d8a041d9aa1e3ba03d770104/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:25.013572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47105f1-cf31-41ec-ade2-2a39c61d2fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045308cda7a449d7a44d1e84aa7c1a9d, user_id=02e04f57d8a041d9aa1e3ba03d770104, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:25.016281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47105f1-cf31-41ec-ade2-2a39c61d2fd7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:25.043898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1192/2386] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:24 2022] PUT /identity/v3/projects/045308cda7a449d7a44d1e84aa7c1a9d/users/02e04f57d8a041d9aa1e3ba03d770104/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:33:25.046303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f581f8-cc42-4d7b-aed7-a4f86adbe953 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:25.046614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f581f8-cc42-4d7b-aed7-a4f86adbe953 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:25.046906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f581f8-cc42-4d7b-aed7-a4f86adbe953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:25.079458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f2f581f8-cc42-4d7b-aed7-a4f86adbe953 None None] MFA Rules not processed for user `02e04f57d8a041d9aa1e3ba03d770104`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:25.081191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f2f581f8-cc42-4d7b-aed7-a4f86adbe953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:25.161630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1195/2387] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:25.170148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47105f1-cf31-41ec-ade2-2a39c61d2fd7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:25.171989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d47105f1-cf31-41ec-ade2-2a39c61d2fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:25.238510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47105f1-cf31-41ec-ade2-2a39c61d2fd7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:25.247203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae0369-e571-46a8-98e5-023c70d7a17a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb8054ea4249d18903b5998fa753d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:25.249953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae0369-e571-46a8-98e5-023c70d7a17a service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:25.250245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae0369-e571-46a8-98e5-023c70d7a17a service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:25.250521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae0369-e571-46a8-98e5-023c70d7a17a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:25.266460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae0369-e571-46a8-98e5-023c70d7a17a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:25.267961 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae0369-e571-46a8-98e5-023c70d7a17a service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:25.283937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1193/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:27.386490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f581f8-cc42-4d7b-aed7-a4f86adbe953 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:27.388925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f2f581f8-cc42-4d7b-aed7-a4f86adbe953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:27.577678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f581f8-cc42-4d7b-aed7-a4f86adbe953 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:27.598203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ffc00-7287-4c04-b01d-851fccb759a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:27.599374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ffc00-7287-4c04-b01d-851fccb759a8 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:27.602043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ffc00-7287-4c04-b01d-851fccb759a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:27.602758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ffc00-7287-4c04-b01d-851fccb759a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:27.609317 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b4ffc00-7287-4c04-b01d-851fccb759a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:27.648615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ffc00-7287-4c04-b01d-851fccb759a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:27.652069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ffc00-7287-4c04-b01d-851fccb759a8 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:27.679059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1196/2389] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:32.569212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae0369-e571-46a8-98e5-023c70d7a17a service glance] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:32.570913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6bae0369-e571-46a8-98e5-023c70d7a17a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:32.607174 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:32.641594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae0369-e571-46a8-98e5-023c70d7a17a service glance] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:32.645889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:32.646982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:32.647266 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:32.647523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:32.649720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:32.659949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:32.661430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:32.672605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1194/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:33.617465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ffc00-7287-4c04-b01d-851fccb759a8 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:33.628144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ffc00-7287-4c04-b01d-851fccb759a8 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:33.632480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:33.633253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:33.633568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:33.633838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:33.635920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:33.656497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:33.703493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:33.704983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:33.714979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1197/2391] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:37.189892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:37.192643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:37.232795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db1ba-90a5-43c3-b297-4c5c0f573132 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:37.245780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:37.247284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:37.247768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:37.248261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:37.253594 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:37.270604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:37.272538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:37.285193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1195/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:37.509984 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:37.511616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:37.591918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03466-0297-4ceb-99c6-82cb5b4d7eaf service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:37.598456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c8df3-b9da-4832-82dc-5b1732884f98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:37.599104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8df3-b9da-4832-82dc-5b1732884f98 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:37.599384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8df3-b9da-4832-82dc-5b1732884f98 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:37.599653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8df3-b9da-4832-82dc-5b1732884f98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:37.601821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-994c8df3-b9da-4832-82dc-5b1732884f98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:37.616218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c8df3-b9da-4832-82dc-5b1732884f98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:37.617754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c8df3-b9da-4832-82dc-5b1732884f98 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:37.641558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1198/2393] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:37.698099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:37.701484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:37.729287 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a41c86-6029-4674-8189-9c8c760312e0 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:37.733053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:37.733772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:37.734050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:37.734323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] PATH_INFO: `/v3/users/d9934866496945b7bdebd7e7e78c24b4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:37.735580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9934866496945b7bdebd7e7e78c24b4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:37.737785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:37.794390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9934866496945b7bdebd7e7e78c24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:37.804403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9934866496945b7bdebd7e7e78c24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:37.819321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9934866496945b7bdebd7e7e78c24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:37.828577 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9934866496945b7bdebd7e7e78c24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:37.829666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-39f7962b-6e2e-4211-a0c9-98971551552b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9934866496945b7bdebd7e7e78c24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:37.839065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1196/2394] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:37 2022] DELETE /identity/v3/users/d9934866496945b7bdebd7e7e78c24b4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:38.056053 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c8df3-b9da-4832-82dc-5b1732884f98 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:38.068897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c8df3-b9da-4832-82dc-5b1732884f98 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:38.139663 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:38.140404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.140692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.140969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] PATH_INFO: `/v3/projects/93c4e69cb1ef43bcb37159e6a6e1fcfa` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.142215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c4e69cb1ef43bcb37159e6a6e1fcfa)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:38.144836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:38.199341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:38.200975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c4e69cb1ef43bcb37159e6a6e1fcfa', 'request_id': 'req-ed14e9ab-6691-41a2-b5f8-67c129c314d8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:38.210972 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c4e69cb1ef43bcb37159e6a6e1fcfa', 'request_id': 'req-ed14e9ab-6691-41a2-b5f8-67c129c314d8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:38.218325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c4e69cb1ef43bcb37159e6a6e1fcfa', 'request_id': 'req-ed14e9ab-6691-41a2-b5f8-67c129c314d8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:38.233442 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] The token cache is being invalidate because project 93c4e69cb1ef43bcb37159e6a6e1fcfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:38.233759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:38.234427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ed14e9ab-6691-41a2-b5f8-67c129c314d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:38.236039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1199/2395] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:38 2022] DELETE /identity/v3/projects/93c4e69cb1ef43bcb37159e6a6e1fcfa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:38.242273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0323ee-70c6-412a-9e9f-b9d1a18f59d0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.242856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0323ee-70c6-412a-9e9f-b9d1a18f59d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.242856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0323ee-70c6-412a-9e9f-b9d1a18f59d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.266873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ee0323ee-70c6-412a-9e9f-b9d1a18f59d0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:38.268427 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ee0323ee-70c6-412a-9e9f-b9d1a18f59d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:38.334072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1197/2396] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:38.342360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca63e-a9fc-477a-94aa-15160566c15f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.342648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca63e-a9fc-477a-94aa-15160566c15f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.342921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca63e-a9fc-477a-94aa-15160566c15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.363750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7e6ca63e-a9fc-477a-94aa-15160566c15f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:38.364695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7e6ca63e-a9fc-477a-94aa-15160566c15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:38.373650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1200/2397] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:38.378121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0323ee-70c6-412a-9e9f-b9d1a18f59d0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:38.389769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0323ee-70c6-412a-9e9f-b9d1a18f59d0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:38.394930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4c15-8313-4d26-9c34-7ea9737328fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:38.395563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4c15-8313-4d26-9c34-7ea9737328fc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.395841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4c15-8313-4d26-9c34-7ea9737328fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.396112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4c15-8313-4d26-9c34-7ea9737328fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.396815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4c15-8313-4d26-9c34-7ea9737328fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:33:38.397121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4c15-8313-4d26-9c34-7ea9737328fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:38.398794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4c15-8313-4d26-9c34-7ea9737328fc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:38.412405 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1198/2398] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:33:38.427014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca63e-a9fc-477a-94aa-15160566c15f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:38.437141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca63e-a9fc-477a-94aa-15160566c15f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:38.442691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d315b3-2233-453d-91ec-9af614ddebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:38.443320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d315b3-2233-453d-91ec-9af614ddebb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.443600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d315b3-2233-453d-91ec-9af614ddebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.443875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d315b3-2233-453d-91ec-9af614ddebb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.444563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d315b3-2233-453d-91ec-9af614ddebb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:38.446956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d315b3-2233-453d-91ec-9af614ddebb0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:38.477578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1201/2399] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:38 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:33:38.481857 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4c15-8313-4d26-9c34-7ea9737328fc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:38.492515 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4c15-8313-4d26-9c34-7ea9737328fc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:38.502691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:38.561122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab3973-418f-49cb-afd4-bcff913a00d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:38.561781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab3973-418f-49cb-afd4-bcff913a00d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.562032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab3973-418f-49cb-afd4-bcff913a00d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.562389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab3973-418f-49cb-afd4-bcff913a00d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.563022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab3973-418f-49cb-afd4-bcff913a00d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:38.564948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab3973-418f-49cb-afd4-bcff913a00d1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:38.587822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1199/2400] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:38 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:38.591939 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d315b3-2233-453d-91ec-9af614ddebb0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:38.604208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d315b3-2233-453d-91ec-9af614ddebb0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:38.609063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515c9fc-642e-4910-819b-c452d7bbf098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:38.609720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c9fc-642e-4910-819b-c452d7bbf098 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.609998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c9fc-642e-4910-819b-c452d7bbf098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.610266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c9fc-642e-4910-819b-c452d7bbf098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.610932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515c9fc-642e-4910-819b-c452d7bbf098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:38.612561 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515c9fc-642e-4910-819b-c452d7bbf098 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:38.623170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1202/2401] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:38.627520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab3973-418f-49cb-afd4-bcff913a00d1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:38.638506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab3973-418f-49cb-afd4-bcff913a00d1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:38.644118 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42445f6e-7825-4c7c-9b36-2c4de195b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:38.644685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445f6e-7825-4c7c-9b36-2c4de195b53b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.644963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445f6e-7825-4c7c-9b36-2c4de195b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.645291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445f6e-7825-4c7c-9b36-2c4de195b53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.645998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42445f6e-7825-4c7c-9b36-2c4de195b53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:38.647591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42445f6e-7825-4c7c-9b36-2c4de195b53b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:38.659015 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1200/2402] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:38.663551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515c9fc-642e-4910-819b-c452d7bbf098 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:38.674392 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515c9fc-642e-4910-819b-c452d7bbf098 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:38.679297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621fd62-e68d-4900-a6d8-c35c27e360b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:38.679988 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621fd62-e68d-4900-a6d8-c35c27e360b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.680266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621fd62-e68d-4900-a6d8-c35c27e360b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.680546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621fd62-e68d-4900-a6d8-c35c27e360b3 admin admin] PATH_INFO: `/v3/projects/3e55eb7830d1440c8c38b6c453111370/users/b35214a901244ddd96bf5958d2f407b4/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.697948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621fd62-e68d-4900-a6d8-c35c27e360b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e55eb7830d1440c8c38b6c453111370, user_id=b35214a901244ddd96bf5958d2f407b4, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:38.700650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621fd62-e68d-4900-a6d8-c35c27e360b3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:38.717641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1203/2403] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:38 2022] PUT /identity/v3/projects/3e55eb7830d1440c8c38b6c453111370/users/b35214a901244ddd96bf5958d2f407b4/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:38.724506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067075-9e4c-4e2a-b764-acf7a88c43d7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.724824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067075-9e4c-4e2a-b764-acf7a88c43d7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.725099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067075-9e4c-4e2a-b764-acf7a88c43d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.745946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-40067075-9e4c-4e2a-b764-acf7a88c43d7 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:38.747162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-40067075-9e4c-4e2a-b764-acf7a88c43d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:38.807476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1201/2404] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:38.817819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621fd62-e68d-4900-a6d8-c35c27e360b3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:38.819830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8621fd62-e68d-4900-a6d8-c35c27e360b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:38.881953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621fd62-e68d-4900-a6d8-c35c27e360b3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:38.885882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011546-4f38-461e-8637-d0d7adf4b8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:38.886513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011546-4f38-461e-8637-d0d7adf4b8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:38.886787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011546-4f38-461e-8637-d0d7adf4b8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:38.887057 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011546-4f38-461e-8637-d0d7adf4b8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:38.897540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f011546-4f38-461e-8637-d0d7adf4b8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:38.898933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f011546-4f38-461e-8637-d0d7adf4b8f4 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:38.908661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1204/2405] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:39.183176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067075-9e4c-4e2a-b764-acf7a88c43d7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:39.185427 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-40067075-9e4c-4e2a-b764-acf7a88c43d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:39.278036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067075-9e4c-4e2a-b764-acf7a88c43d7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:39.286134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1941f9-bba7-45b5-b7cd-febd5d5d1e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:39.286780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1941f9-bba7-45b5-b7cd-febd5d5d1e35 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:39.287066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1941f9-bba7-45b5-b7cd-febd5d5d1e35 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:39.287345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1941f9-bba7-45b5-b7cd-febd5d5d1e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:39.289926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f1941f9-bba7-45b5-b7cd-febd5d5d1e35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:39.329320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:39.368791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1941f9-bba7-45b5-b7cd-febd5d5d1e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:39.370510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1941f9-bba7-45b5-b7cd-febd5d5d1e35 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:39.382507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1202/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:39.935648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546926ac-e7bd-4fe2-b898-474c5e46cc4a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:39.936608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546926ac-e7bd-4fe2-b898-474c5e46cc4a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:39.937670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546926ac-e7bd-4fe2-b898-474c5e46cc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:40.011497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-546926ac-e7bd-4fe2-b898-474c5e46cc4a None None] MFA Rules not processed for user `b35214a901244ddd96bf5958d2f407b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:40.012816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-546926ac-e7bd-4fe2-b898-474c5e46cc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:40.084616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1205/2407] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:40.089196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1941f9-bba7-45b5-b7cd-febd5d5d1e35 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:40.100148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1941f9-bba7-45b5-b7cd-febd5d5d1e35 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:40.105399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a2804-5473-404a-911a-c69d0507fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:40.106030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a2804-5473-404a-911a-c69d0507fa8d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:40.106311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a2804-5473-404a-911a-c69d0507fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:40.106575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a2804-5473-404a-911a-c69d0507fa8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:40.107261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a2804-5473-404a-911a-c69d0507fa8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:40.109152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a2804-5473-404a-911a-c69d0507fa8d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:40.141815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1203/2408] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:40 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:33:40.146004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546926ac-e7bd-4fe2-b898-474c5e46cc4a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:40.154497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:40.161604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546926ac-e7bd-4fe2-b898-474c5e46cc4a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:40.204950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816353b-585d-4ccd-a98c-a185657661d3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:40.205624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816353b-585d-4ccd-a98c-a185657661d3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:40.205624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816353b-585d-4ccd-a98c-a185657661d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:40.224674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d1ed2-daee-4aa0-a83a-8d943dde6d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:40.225341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d1ed2-daee-4aa0-a83a-8d943dde6d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:40.225620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f816353b-585d-4ccd-a98c-a185657661d3 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:40.225747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d1ed2-daee-4aa0-a83a-8d943dde6d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:40.225885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d1ed2-daee-4aa0-a83a-8d943dde6d21 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:40.226606 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d1ed2-daee-4aa0-a83a-8d943dde6d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:40.226886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f816353b-585d-4ccd-a98c-a185657661d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:40.229763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d1ed2-daee-4aa0-a83a-8d943dde6d21 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:40.254087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1206/2409] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:40 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:40.258654 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d1ed2-daee-4aa0-a83a-8d943dde6d21 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:40.269412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d1ed2-daee-4aa0-a83a-8d943dde6d21 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:40.274646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d2835-659a-4d8b-b260-63d14c9658af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:40.275287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d2835-659a-4d8b-b260-63d14c9658af admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:40.275613 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d2835-659a-4d8b-b260-63d14c9658af admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:40.276010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d2835-659a-4d8b-b260-63d14c9658af admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:40.276855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d2835-659a-4d8b-b260-63d14c9658af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:40.278500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d2835-659a-4d8b-b260-63d14c9658af admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:40.287168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1204/2410] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:33:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:33:40.291883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1207/2411] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:40.292932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816353b-585d-4ccd-a98c-a185657661d3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:40.299132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d2835-659a-4d8b-b260-63d14c9658af admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:40.300908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fe5d2835-659a-4d8b-b260-63d14c9658af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:40.304627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816353b-585d-4ccd-a98c-a185657661d3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:40.309417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a9599-24b1-4575-9f08-d390a8b3e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:40.310093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a9599-24b1-4575-9f08-d390a8b3e479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:40.310367 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a9599-24b1-4575-9f08-d390a8b3e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:40.310657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a9599-24b1-4575-9f08-d390a8b3e479 admin admin] PATH_INFO: `/v3/projects/e4e58d53962f47b5a730765b6fb4b74c/users/4d669718b99843f5905e9035eadbc721/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:40.326299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a9599-24b1-4575-9f08-d390a8b3e479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e58d53962f47b5a730765b6fb4b74c, user_id=4d669718b99843f5905e9035eadbc721, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:40.329020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a9599-24b1-4575-9f08-d390a8b3e479 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:40.342882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1205/2412] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:40 2022] PUT /identity/v3/projects/e4e58d53962f47b5a730765b6fb4b74c/users/4d669718b99843f5905e9035eadbc721/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:33:40.346612 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a9599-24b1-4575-9f08-d390a8b3e479 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:40.372513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d2835-659a-4d8b-b260-63d14c9658af admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:40.413624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a9599-24b1-4575-9f08-d390a8b3e479 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:40.418767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f34f2d-7038-4438-9705-5fb45f3fbe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:40.419410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f34f2d-7038-4438-9705-5fb45f3fbe28 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:40.419686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f34f2d-7038-4438-9705-5fb45f3fbe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:40.419955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f34f2d-7038-4438-9705-5fb45f3fbe28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:40.420669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f34f2d-7038-4438-9705-5fb45f3fbe28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:40.422321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f34f2d-7038-4438-9705-5fb45f3fbe28 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:40.433451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1206/2413] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:40.437661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f34f2d-7038-4438-9705-5fb45f3fbe28 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:40.448155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f34f2d-7038-4438-9705-5fb45f3fbe28 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:40.450329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31659006-30d8-46ca-94db-e65a9b6b941c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:40.450974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31659006-30d8-46ca-94db-e65a9b6b941c service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:40.451258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31659006-30d8-46ca-94db-e65a9b6b941c service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:40.451538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31659006-30d8-46ca-94db-e65a9b6b941c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:40.453346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49208c-ae10-4c62-a0ce-8dbcc9eb47d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:40.454022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49208c-ae10-4c62-a0ce-8dbcc9eb47d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:40.454297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49208c-ae10-4c62-a0ce-8dbcc9eb47d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:40.454565 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49208c-ae10-4c62-a0ce-8dbcc9eb47d6 admin admin] PATH_INFO: `/v3/projects/e4e58d53962f47b5a730765b6fb4b74c/users/4d669718b99843f5905e9035eadbc721/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:40.457222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49208c-ae10-4c62-a0ce-8dbcc9eb47d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e58d53962f47b5a730765b6fb4b74c, user_id=4d669718b99843f5905e9035eadbc721, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:40.460028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49208c-ae10-4c62-a0ce-8dbcc9eb47d6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:40.471535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1207/2414] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:40 2022] PUT /identity/v3/projects/e4e58d53962f47b5a730765b6fb4b74c/users/4d669718b99843f5905e9035eadbc721/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:33:40.479375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:40.512041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31659006-30d8-46ca-94db-e65a9b6b941c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:40.513739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31659006-30d8-46ca-94db-e65a9b6b941c service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:40.523514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1208/2415] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:33:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 07:33:41.521096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb243-69df-40dc-bd50-86ee0cc962f5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:41.521838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb243-69df-40dc-bd50-86ee0cc962f5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:41.521838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb243-69df-40dc-bd50-86ee0cc962f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:41.546670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:41.558557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-30abb243-69df-40dc-bd50-86ee0cc962f5 None None] MFA Rules not processed for user `4d669718b99843f5905e9035eadbc721`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:41.561105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-30abb243-69df-40dc-bd50-86ee0cc962f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:41.702574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1208/2416] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:33:43.514412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31659006-30d8-46ca-94db-e65a9b6b941c service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:43.543245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31659006-30d8-46ca-94db-e65a9b6b941c service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:43.632137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:43.632137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:43.632137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:43.632137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] PATH_INFO: `/v3/users/b35214a901244ddd96bf5958d2f407b4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:43.633094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35214a901244ddd96bf5958d2f407b4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:43.637158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:43.728989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35214a901244ddd96bf5958d2f407b4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:43.729810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35214a901244ddd96bf5958d2f407b4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:43.730667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35214a901244ddd96bf5958d2f407b4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:43.744531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35214a901244ddd96bf5958d2f407b4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:43.761678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35214a901244ddd96bf5958d2f407b4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:43.778580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1209/2417] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:43 2022] DELETE /identity/v3/users/b35214a901244ddd96bf5958d2f407b4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:43.984452 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb243-69df-40dc-bd50-86ee0cc962f5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:44.004691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb243-69df-40dc-bd50-86ee0cc962f5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:44.097303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:44.097976 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:44.098251 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:44.098651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] PATH_INFO: `/v3/projects/3e55eb7830d1440c8c38b6c453111370` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:44.099922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e55eb7830d1440c8c38b6c453111370)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:44.102053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:44.170719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e55eb7830d1440c8c38b6c453111370', 'request_id': 'req-757352db-3fd3-4b41-96ff-341861b8c5af'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.187135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e55eb7830d1440c8c38b6c453111370', 'request_id': 'req-757352db-3fd3-4b41-96ff-341861b8c5af'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.206335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e55eb7830d1440c8c38b6c453111370', 'request_id': 'req-757352db-3fd3-4b41-96ff-341861b8c5af'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.233709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] The token cache is being invalidate because project 3e55eb7830d1440c8c38b6c453111370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:44.234221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.234986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.236794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1209/2418] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:43 2022] DELETE /identity/v3/projects/3e55eb7830d1440c8c38b6c453111370 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:44.241122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:44.243454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:44.259539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e784d17-c37f-4069-aac0-e53420a9572e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:44.331512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:44.366553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:44.367473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:44.367755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:44.368252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] PATH_INFO: `/v3/users/4d669718b99843f5905e9035eadbc721` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:44.370509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d669718b99843f5905e9035eadbc721)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:44.373456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:44.466416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d669718b99843f5905e9035eadbc721'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.467073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d669718b99843f5905e9035eadbc721'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.467678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d669718b99843f5905e9035eadbc721'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.486786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d669718b99843f5905e9035eadbc721'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.496822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d524ba80-ba53-4601-bd65-2d6446ef4dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d669718b99843f5905e9035eadbc721'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.510816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1210/2419] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:44 2022] DELETE /identity/v3/users/4d669718b99843f5905e9035eadbc721 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:33:44.724309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:44.726722 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:44.749601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757352db-3fd3-4b41-96ff-341861b8c5af admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:44.796980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:44.839935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:44.840607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:44.840888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:44.841170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] PATH_INFO: `/v3/projects/e4e58d53962f47b5a730765b6fb4b74c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:44.842421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e58d53962f47b5a730765b6fb4b74c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:44.844726 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:44.930114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e58d53962f47b5a730765b6fb4b74c', 'request_id': 'req-308e8916-1b19-4c31-b323-903899d775e3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.940319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e58d53962f47b5a730765b6fb4b74c', 'request_id': 'req-308e8916-1b19-4c31-b323-903899d775e3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.948648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e58d53962f47b5a730765b6fb4b74c', 'request_id': 'req-308e8916-1b19-4c31-b323-903899d775e3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.964100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] The token cache is being invalidate because project e4e58d53962f47b5a730765b6fb4b74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:44.964538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.965310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-308e8916-1b19-4c31-b323-903899d775e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:44.971177 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1210/2420] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:44 2022] DELETE /identity/v3/projects/e4e58d53962f47b5a730765b6fb4b74c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:44.972951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a137-23ae-4d5b-abe5-88c993c573de None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:44.973462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a137-23ae-4d5b-abe5-88c993c573de None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:44.973594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a137-23ae-4d5b-abe5-88c993c573de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.018400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-18b2a137-23ae-4d5b-abe5-88c993c573de None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:45.018400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-18b2a137-23ae-4d5b-abe5-88c993c573de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:45.102189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1211/2421] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:45.110704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb921d03-8172-4f52-a0c0-d88d2dbfab4a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.111272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb921d03-8172-4f52-a0c0-d88d2dbfab4a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.111272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb921d03-8172-4f52-a0c0-d88d2dbfab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.134261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cb921d03-8172-4f52-a0c0-d88d2dbfab4a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:45.135491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cb921d03-8172-4f52-a0c0-d88d2dbfab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:45.144784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1211/2422] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:45.149628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2a137-23ae-4d5b-abe5-88c993c573de None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:45.160545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2a137-23ae-4d5b-abe5-88c993c573de None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:45.165449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5373f18-7af2-4c2b-8cc5-98ee1c83f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:45.166079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5373f18-7af2-4c2b-8cc5-98ee1c83f6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.166354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5373f18-7af2-4c2b-8cc5-98ee1c83f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.166621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5373f18-7af2-4c2b-8cc5-98ee1c83f6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.167325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5373f18-7af2-4c2b-8cc5-98ee1c83f6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:33:45.167627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5373f18-7af2-4c2b-8cc5-98ee1c83f6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:45.169215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5373f18-7af2-4c2b-8cc5-98ee1c83f6d7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:45.187022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1212/2423] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:33:45.188388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb921d03-8172-4f52-a0c0-d88d2dbfab4a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:45.200785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb921d03-8172-4f52-a0c0-d88d2dbfab4a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:45.207004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a12a3-1be9-439a-9f0d-01818f49cdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:45.207888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a12a3-1be9-439a-9f0d-01818f49cdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.208332 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a12a3-1be9-439a-9f0d-01818f49cdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.208764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a12a3-1be9-439a-9f0d-01818f49cdd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.209658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a12a3-1be9-439a-9f0d-01818f49cdd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:45.212204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a12a3-1be9-439a-9f0d-01818f49cdd8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:45.261190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1212/2424] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:45 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:45.266465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5373f18-7af2-4c2b-8cc5-98ee1c83f6d7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:45.284469 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5373f18-7af2-4c2b-8cc5-98ee1c83f6d7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:45.349816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:45.361102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae01e2-9370-4385-a7f5-d236c4d625e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:45.361830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae01e2-9370-4385-a7f5-d236c4d625e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.362102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae01e2-9370-4385-a7f5-d236c4d625e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.362390 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae01e2-9370-4385-a7f5-d236c4d625e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.363641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae01e2-9370-4385-a7f5-d236c4d625e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:45.366137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae01e2-9370-4385-a7f5-d236c4d625e8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:45.398141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1213/2425] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:45 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:45.402146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a12a3-1be9-439a-9f0d-01818f49cdd8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:45.416198 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a12a3-1be9-439a-9f0d-01818f49cdd8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:45.421364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5b3bc-ba0e-4810-b4c5-b2d65520b8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:45.422013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5b3bc-ba0e-4810-b4c5-b2d65520b8eb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.422298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5b3bc-ba0e-4810-b4c5-b2d65520b8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.422573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5b3bc-ba0e-4810-b4c5-b2d65520b8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.423292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5b3bc-ba0e-4810-b4c5-b2d65520b8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:45.425111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5b3bc-ba0e-4810-b4c5-b2d65520b8eb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:45.439328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1213/2426] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:45.440847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae01e2-9370-4385-a7f5-d236c4d625e8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:45.453292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae01e2-9370-4385-a7f5-d236c4d625e8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:45.459886 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f343e8-a422-411b-87a9-d48367a84235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:45.462170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f343e8-a422-411b-87a9-d48367a84235 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.462170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f343e8-a422-411b-87a9-d48367a84235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.462170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f343e8-a422-411b-87a9-d48367a84235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.464389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f343e8-a422-411b-87a9-d48367a84235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:45.466853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f343e8-a422-411b-87a9-d48367a84235 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:45.480764 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1214/2427] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:33:45.484789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5b3bc-ba0e-4810-b4c5-b2d65520b8eb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:45.497751 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5b3bc-ba0e-4810-b4c5-b2d65520b8eb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:45.527098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c3aa5-953c-4b1e-a426-fb0f1baedec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:45.527808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3aa5-953c-4b1e-a426-fb0f1baedec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.528089 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3aa5-953c-4b1e-a426-fb0f1baedec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.528370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3aa5-953c-4b1e-a426-fb0f1baedec8 admin admin] PATH_INFO: `/v3/projects/73721850064a44c0a89b9f6deb4511a4/users/54c5fd0a86314d498ec2f55e3b7eabfc/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.544926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c3aa5-953c-4b1e-a426-fb0f1baedec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73721850064a44c0a89b9f6deb4511a4, user_id=54c5fd0a86314d498ec2f55e3b7eabfc, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:45.547818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c3aa5-953c-4b1e-a426-fb0f1baedec8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:45.563542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1214/2428] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:45 2022] PUT /identity/v3/projects/73721850064a44c0a89b9f6deb4511a4/users/54c5fd0a86314d498ec2f55e3b7eabfc/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:45.575006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263b63-7557-4ed1-91c0-79d3c868bd6c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.575468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263b63-7557-4ed1-91c0-79d3c868bd6c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.575818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263b63-7557-4ed1-91c0-79d3c868bd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.637810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1b263b63-7557-4ed1-91c0-79d3c868bd6c None None] MFA Rules not processed for user `54c5fd0a86314d498ec2f55e3b7eabfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:45.639151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1b263b63-7557-4ed1-91c0-79d3c868bd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:45.741202 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1215/2429] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:45.747119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c3aa5-953c-4b1e-a426-fb0f1baedec8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:45.810086 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:45.829080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c3aa5-953c-4b1e-a426-fb0f1baedec8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:45.834150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7a9b3-27ed-4bac-bb42-c9d71825fe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:45.834799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7a9b3-27ed-4bac-bb42-c9d71825fe51 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.835074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7a9b3-27ed-4bac-bb42-c9d71825fe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.835349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7a9b3-27ed-4bac-bb42-c9d71825fe51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.836105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7a9b3-27ed-4bac-bb42-c9d71825fe51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:45.838077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7a9b3-27ed-4bac-bb42-c9d71825fe51 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:45.867733 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1215/2430] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:45 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:45.872289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263b63-7557-4ed1-91c0-79d3c868bd6c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:45.884013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263b63-7557-4ed1-91c0-79d3c868bd6c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:45.950927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eaf4e-5ce8-4505-8cbf-3e495aaf92d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:45.951811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eaf4e-5ce8-4505-8cbf-3e495aaf92d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:45.952156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eaf4e-5ce8-4505-8cbf-3e495aaf92d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:45.952516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eaf4e-5ce8-4505-8cbf-3e495aaf92d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:45.953326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eaf4e-5ce8-4505-8cbf-3e495aaf92d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:45.956478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eaf4e-5ce8-4505-8cbf-3e495aaf92d5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:45.984059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1216/2431] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:45 2022] POST /identity/v3/users => generated 303 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:45.988066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7a9b3-27ed-4bac-bb42-c9d71825fe51 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:45.999571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7a9b3-27ed-4bac-bb42-c9d71825fe51 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:46.006122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d70a04-22e1-4cb9-b8f8-d03697aebb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:46.006827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d70a04-22e1-4cb9-b8f8-d03697aebb29 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:46.007171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d70a04-22e1-4cb9-b8f8-d03697aebb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:46.007836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d70a04-22e1-4cb9-b8f8-d03697aebb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:46.008738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d70a04-22e1-4cb9-b8f8-d03697aebb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:46.010465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d70a04-22e1-4cb9-b8f8-d03697aebb29 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:46.024921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1216/2432] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:46.029848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eaf4e-5ce8-4505-8cbf-3e495aaf92d5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:46.042348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eaf4e-5ce8-4505-8cbf-3e495aaf92d5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:46.048017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30c2f5-9962-4c9c-8726-63bae90f5a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:46.048829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30c2f5-9962-4c9c-8726-63bae90f5a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:46.049175 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30c2f5-9962-4c9c-8726-63bae90f5a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:46.049556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30c2f5-9962-4c9c-8726-63bae90f5a56 admin admin] PATH_INFO: `/v3/projects/8382781e572345d9ae9ca249e311c881/users/eb011ecd15f7499cb1cc73e4d3287c9a/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:46.076079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30c2f5-9962-4c9c-8726-63bae90f5a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8382781e572345d9ae9ca249e311c881, user_id=eb011ecd15f7499cb1cc73e4d3287c9a, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:46.078973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30c2f5-9962-4c9c-8726-63bae90f5a56 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:46.093397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1217/2433] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:46 2022] PUT /identity/v3/projects/8382781e572345d9ae9ca249e311c881/users/eb011ecd15f7499cb1cc73e4d3287c9a/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:33:46.097533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d70a04-22e1-4cb9-b8f8-d03697aebb29 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:46.110443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d70a04-22e1-4cb9-b8f8-d03697aebb29 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:46.221127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114df685-15dc-4f25-9a14-a0f99005702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:46.223099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114df685-15dc-4f25-9a14-a0f99005702e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:46.223429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114df685-15dc-4f25-9a14-a0f99005702e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:46.223801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114df685-15dc-4f25-9a14-a0f99005702e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:46.224586 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114df685-15dc-4f25-9a14-a0f99005702e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:46.226370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114df685-15dc-4f25-9a14-a0f99005702e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:46.237805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1217/2434] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:33:46.242477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30c2f5-9962-4c9c-8726-63bae90f5a56 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:46.254285 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30c2f5-9962-4c9c-8726-63bae90f5a56 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:46.259856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811495b-1c93-4256-960e-3711a697307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:46.260560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811495b-1c93-4256-960e-3711a697307e admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:46.260841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811495b-1c93-4256-960e-3711a697307e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:46.261115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811495b-1c93-4256-960e-3711a697307e admin admin] PATH_INFO: `/v3/projects/8382781e572345d9ae9ca249e311c881/users/eb011ecd15f7499cb1cc73e4d3287c9a/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:46.263234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811495b-1c93-4256-960e-3711a697307e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8382781e572345d9ae9ca249e311c881, user_id=eb011ecd15f7499cb1cc73e4d3287c9a, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:46.266085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811495b-1c93-4256-960e-3711a697307e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:46.278415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1218/2435] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:46 2022] PUT /identity/v3/projects/8382781e572345d9ae9ca249e311c881/users/eb011ecd15f7499cb1cc73e4d3287c9a/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:46.290890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13ef0-ae66-4cc8-b0da-9173a9d50511 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:46.291094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13ef0-ae66-4cc8-b0da-9173a9d50511 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:46.291679 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13ef0-ae66-4cc8-b0da-9173a9d50511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:46.323486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3cf13ef0-ae66-4cc8-b0da-9173a9d50511 None None] MFA Rules not processed for user `eb011ecd15f7499cb1cc73e4d3287c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:46.325329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3cf13ef0-ae66-4cc8-b0da-9173a9d50511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:46.420967 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1218/2436] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:46.433359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811495b-1c93-4256-960e-3711a697307e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:46.435229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9811495b-1c93-4256-960e-3711a697307e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:46.452573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:46.499630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811495b-1c93-4256-960e-3711a697307e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:46.503554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8ee4c-f7cc-4c27-b66c-e113b5ee48e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:46.504199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8ee4c-f7cc-4c27-b66c-e113b5ee48e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:46.504540 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8ee4c-f7cc-4c27-b66c-e113b5ee48e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:46.504759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8ee4c-f7cc-4c27-b66c-e113b5ee48e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:46.515319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8ee4c-f7cc-4c27-b66c-e113b5ee48e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:46.516821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8ee4c-f7cc-4c27-b66c-e113b5ee48e9 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:46.526978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1219/2437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:46.587677 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13ef0-ae66-4cc8-b0da-9173a9d50511 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:46.589407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3cf13ef0-ae66-4cc8-b0da-9173a9d50511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:46.601984 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13ef0-ae66-4cc8-b0da-9173a9d50511 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:46.607313 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fdb40-9f9b-4cd6-a935-3b21a0f332ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:46.608197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fdb40-9f9b-4cd6-a935-3b21a0f332ee service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:46.608637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fdb40-9f9b-4cd6-a935-3b21a0f332ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:46.609159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fdb40-9f9b-4cd6-a935-3b21a0f332ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:46.669530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:46.683966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fdb40-9f9b-4cd6-a935-3b21a0f332ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:46.685499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fdb40-9f9b-4cd6-a935-3b21a0f332ee service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:46.696927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1219/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:49.038601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8ee4c-f7cc-4c27-b66c-e113b5ee48e9 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:49.040138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a6c8ee4c-f7cc-4c27-b66c-e113b5ee48e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:49.114574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8ee4c-f7cc-4c27-b66c-e113b5ee48e9 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:49.119685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:49.120340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:49.120624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:49.120906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] PATH_INFO: `/v3/users/02e04f57d8a041d9aa1e3ba03d770104` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:49.122123 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e04f57d8a041d9aa1e3ba03d770104)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:49.124058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:49.180528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e04f57d8a041d9aa1e3ba03d770104'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.181611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e04f57d8a041d9aa1e3ba03d770104'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.182719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e04f57d8a041d9aa1e3ba03d770104'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.198870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e04f57d8a041d9aa1e3ba03d770104'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.207229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e04f57d8a041d9aa1e3ba03d770104'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.226386 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1220/2439] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:49 2022] DELETE /identity/v3/users/02e04f57d8a041d9aa1e3ba03d770104 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:49.231644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c696-234f-4232-a491-3eea6577ba56 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:49.232247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c696-234f-4232-a491-3eea6577ba56 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:49.232247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c696-234f-4232-a491-3eea6577ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:49.257817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7c54c696-234f-4232-a491-3eea6577ba56 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:49.259059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c54c696-234f-4232-a491-3eea6577ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:49.326931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1220/2440] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:49.337531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:49.339626 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:49.387458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:49.415352 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e5bbd-5618-4b4a-a9e6-b4b6b7c2d457 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:49.421941 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4d3b6-4549-4cd1-8e1f-6086c92d981c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:49.423030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4d3b6-4549-4cd1-8e1f-6086c92d981c service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:49.423544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4d3b6-4549-4cd1-8e1f-6086c92d981c service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:49.424048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4d3b6-4549-4cd1-8e1f-6086c92d981c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:49.438773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4d3b6-4549-4cd1-8e1f-6086c92d981c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:49.440479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4d3b6-4549-4cd1-8e1f-6086c92d981c service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:49.451975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1221/2441] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:33:49.736885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54c696-234f-4232-a491-3eea6577ba56 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:49.738500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c54c696-234f-4232-a491-3eea6577ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:49.751596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54c696-234f-4232-a491-3eea6577ba56 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:49.756516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:49.757169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:49.757505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:49.757761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] PATH_INFO: `/v3/projects/045308cda7a449d7a44d1e84aa7c1a9d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:49.758946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] RBAC: Authorizing `identity:delete_project(project_id=045308cda7a449d7a44d1e84aa7c1a9d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:49.760851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:49.822707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045308cda7a449d7a44d1e84aa7c1a9d', 'request_id': 'req-2bc704cd-0439-4b57-a024-209de35b861a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.834269 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045308cda7a449d7a44d1e84aa7c1a9d', 'request_id': 'req-2bc704cd-0439-4b57-a024-209de35b861a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.840867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045308cda7a449d7a44d1e84aa7c1a9d', 'request_id': 'req-2bc704cd-0439-4b57-a024-209de35b861a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.852863 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] The token cache is being invalidate because project 045308cda7a449d7a44d1e84aa7c1a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:49.853225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.853950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2bc704cd-0439-4b57-a024-209de35b861a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:49.855610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1221/2442] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:49 2022] DELETE /identity/v3/projects/045308cda7a449d7a44d1e84aa7c1a9d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:49.866713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3b065-d7bc-42bb-b444-bf05b52a9de3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:49.867092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3b065-d7bc-42bb-b444-bf05b52a9de3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:49.867435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3b065-d7bc-42bb-b444-bf05b52a9de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:49.887539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-20e3b065-d7bc-42bb-b444-bf05b52a9de3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:49.888755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-20e3b065-d7bc-42bb-b444-bf05b52a9de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:49.950853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1222/2443] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:33:49.959518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced486d-fba5-4b45-b728-7e11f1b91a35 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:49.959782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced486d-fba5-4b45-b728-7e11f1b91a35 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:49.960090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced486d-fba5-4b45-b728-7e11f1b91a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:49.982035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-aced486d-fba5-4b45-b728-7e11f1b91a35 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:49.983196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-aced486d-fba5-4b45-b728-7e11f1b91a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:49.992842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1222/2444] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:49.998036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3b065-d7bc-42bb-b444-bf05b52a9de3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.011642 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3b065-d7bc-42bb-b444-bf05b52a9de3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.017150 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a99ff-4385-4eb0-a9fb-fe1e6860deed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.017837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a99ff-4385-4eb0-a9fb-fe1e6860deed admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.018120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a99ff-4385-4eb0-a9fb-fe1e6860deed admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.018389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a99ff-4385-4eb0-a9fb-fe1e6860deed admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.019096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a99ff-4385-4eb0-a9fb-fe1e6860deed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:33:50.019400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a99ff-4385-4eb0-a9fb-fe1e6860deed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.021093 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a99ff-4385-4eb0-a9fb-fe1e6860deed admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.034071 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1223/2445] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:33:50.038639 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced486d-fba5-4b45-b728-7e11f1b91a35 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.048810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced486d-fba5-4b45-b728-7e11f1b91a35 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.054551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ff9d-6379-4d89-afa1-022b4f71dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.055303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ff9d-6379-4d89-afa1-022b4f71dee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.055461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ff9d-6379-4d89-afa1-022b4f71dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.055732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ff9d-6379-4d89-afa1-022b4f71dee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.056442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31ff9d-6379-4d89-afa1-022b4f71dee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.058365 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31ff9d-6379-4d89-afa1-022b4f71dee8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.092030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1223/2446] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:50 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:50.093867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a99ff-4385-4eb0-a9fb-fe1e6860deed admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.104316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a99ff-4385-4eb0-a9fb-fe1e6860deed admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.168151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052fa70-758d-412f-b9fa-5ca33edfbb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.168788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052fa70-758d-412f-b9fa-5ca33edfbb29 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.169072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052fa70-758d-412f-b9fa-5ca33edfbb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.169394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052fa70-758d-412f-b9fa-5ca33edfbb29 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.170079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052fa70-758d-412f-b9fa-5ca33edfbb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.172021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052fa70-758d-412f-b9fa-5ca33edfbb29 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.193707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ff9d-6379-4d89-afa1-022b4f71dee8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.195477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ae31ff9d-6379-4d89-afa1-022b4f71dee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:50.197301 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1224/2447] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:50 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:50.200129 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052fa70-758d-412f-b9fa-5ca33edfbb29 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.208736 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ff9d-6379-4d89-afa1-022b4f71dee8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.209687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052fa70-758d-412f-b9fa-5ca33edfbb29 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.213937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.214591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.214825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924af5-cd70-4a5a-958f-dc91509d1a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.214972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.215160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] PATH_INFO: `/v3/users/54c5fd0a86314d498ec2f55e3b7eabfc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.215451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924af5-cd70-4a5a-958f-dc91509d1a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.215785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924af5-cd70-4a5a-958f-dc91509d1a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.216063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924af5-cd70-4a5a-958f-dc91509d1a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.216318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c5fd0a86314d498ec2f55e3b7eabfc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.216766 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924af5-cd70-4a5a-958f-dc91509d1a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.218376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.218508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924af5-cd70-4a5a-958f-dc91509d1a6e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.229763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1225/2448] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:33:50.233610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924af5-cd70-4a5a-958f-dc91509d1a6e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.246485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924af5-cd70-4a5a-958f-dc91509d1a6e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.255141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200038-0b3f-4f43-873e-9a7d8e1da8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.256106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200038-0b3f-4f43-873e-9a7d8e1da8da admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.256402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200038-0b3f-4f43-873e-9a7d8e1da8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.256747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200038-0b3f-4f43-873e-9a7d8e1da8da admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.257591 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200038-0b3f-4f43-873e-9a7d8e1da8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.259291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200038-0b3f-4f43-873e-9a7d8e1da8da admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.271369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1226/2449] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:33:50.275161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:50.276641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200038-0b3f-4f43-873e-9a7d8e1da8da admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.286516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c5fd0a86314d498ec2f55e3b7eabfc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:50.293177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200038-0b3f-4f43-873e-9a7d8e1da8da admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.299371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374b15d-14d4-4c6e-a893-68a2e7496a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.300283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374b15d-14d4-4c6e-a893-68a2e7496a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.300623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374b15d-14d4-4c6e-a893-68a2e7496a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.300991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374b15d-14d4-4c6e-a893-68a2e7496a80 admin admin] PATH_INFO: `/v3/projects/c6e9f830bd3545ea8cd0ffc8ade16672/users/144d14a8ff5c4e5082d8d5495738dfa6/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.307251 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c5fd0a86314d498ec2f55e3b7eabfc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:50.319180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374b15d-14d4-4c6e-a893-68a2e7496a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e9f830bd3545ea8cd0ffc8ade16672, user_id=144d14a8ff5c4e5082d8d5495738dfa6, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.322072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c5fd0a86314d498ec2f55e3b7eabfc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:50.322463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374b15d-14d4-4c6e-a893-68a2e7496a80 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.330446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c5fd0a86314d498ec2f55e3b7eabfc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:50.331334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4d6c10d1-ae21-49e8-88cc-5dcb92dfd190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c5fd0a86314d498ec2f55e3b7eabfc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:50.345409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1227/2450] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:50 2022] PUT /identity/v3/projects/c6e9f830bd3545ea8cd0ffc8ade16672/users/144d14a8ff5c4e5082d8d5495738dfa6/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:50.349298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1224/2451] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:50 2022] DELETE /identity/v3/users/54c5fd0a86314d498ec2f55e3b7eabfc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:33:50.353045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674239e-f91f-466f-9bea-d230ed027f69 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.353372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674239e-f91f-466f-9bea-d230ed027f69 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.353560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674239e-f91f-466f-9bea-d230ed027f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.357991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05aef-3439-4649-bc5a-dc38978c41f7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.358272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05aef-3439-4649-bc5a-dc38978c41f7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.358542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05aef-3439-4649-bc5a-dc38978c41f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.377845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1674239e-f91f-466f-9bea-d230ed027f69 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:50.379263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1674239e-f91f-466f-9bea-d230ed027f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:50.385462 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:50.390381 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-88c05aef-3439-4649-bc5a-dc38978c41f7 None None] MFA Rules not processed for user `144d14a8ff5c4e5082d8d5495738dfa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:50.391652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-88c05aef-3439-4649-bc5a-dc38978c41f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:50.445483 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1228/2452] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:50.455693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674239e-f91f-466f-9bea-d230ed027f69 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.457219 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1674239e-f91f-466f-9bea-d230ed027f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:50.462823 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1225/2453] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:50.473847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c05aef-3439-4649-bc5a-dc38978c41f7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.475296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-88c05aef-3439-4649-bc5a-dc38978c41f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:50.518862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674239e-f91f-466f-9bea-d230ed027f69 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.523265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55645bf-e175-4613-96c8-271bbd615698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.523445 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55645bf-e175-4613-96c8-271bbd615698 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.523622 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55645bf-e175-4613-96c8-271bbd615698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.523869 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55645bf-e175-4613-96c8-271bbd615698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.533655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55645bf-e175-4613-96c8-271bbd615698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.535119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55645bf-e175-4613-96c8-271bbd615698 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.538186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c05aef-3439-4649-bc5a-dc38978c41f7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.542093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5ab4f-cb84-40ee-ba25-83eb91609d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.542731 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ab4f-cb84-40ee-ba25-83eb91609d5e service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.543007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ab4f-cb84-40ee-ba25-83eb91609d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.543280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ab4f-cb84-40ee-ba25-83eb91609d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.544931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1229/2454] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:33:50.552205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5ab4f-cb84-40ee-ba25-83eb91609d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.553691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5ab4f-cb84-40ee-ba25-83eb91609d5e service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.564614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1226/2455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:33:50.863310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55645bf-e175-4613-96c8-271bbd615698 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:50.864931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d55645bf-e175-4613-96c8-271bbd615698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:50.882347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55645bf-e175-4613-96c8-271bbd615698 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:50.901444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:50.902139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:50.902421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:50.903118 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] PATH_INFO: `/v3/projects/73721850064a44c0a89b9f6deb4511a4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:50.904436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73721850064a44c0a89b9f6deb4511a4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:50.906673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:50.969496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73721850064a44c0a89b9f6deb4511a4', 'request_id': 'req-c519b935-1278-4cc5-bb92-8007948da950'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:50.978773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73721850064a44c0a89b9f6deb4511a4', 'request_id': 'req-c519b935-1278-4cc5-bb92-8007948da950'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:50.985543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73721850064a44c0a89b9f6deb4511a4', 'request_id': 'req-c519b935-1278-4cc5-bb92-8007948da950'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.004550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] The token cache is being invalidate because project 73721850064a44c0a89b9f6deb4511a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:51.004550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.004875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.007375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1230/2456] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:50 2022] DELETE /identity/v3/projects/73721850064a44c0a89b9f6deb4511a4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:51.012361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5ab4f-cb84-40ee-ba25-83eb91609d5e service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:51.026245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5ab4f-cb84-40ee-ba25-83eb91609d5e service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:51.076576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:51.096578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:51.097361 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:51.097706 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:51.098050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] PATH_INFO: `/v3/users/eb011ecd15f7499cb1cc73e4d3287c9a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:51.099250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb011ecd15f7499cb1cc73e4d3287c9a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:51.101181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:51.158324 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb011ecd15f7499cb1cc73e4d3287c9a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.166861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb011ecd15f7499cb1cc73e4d3287c9a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.181824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb011ecd15f7499cb1cc73e4d3287c9a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.189471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb011ecd15f7499cb1cc73e4d3287c9a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.190201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4766d3f5-2590-49dc-afda-cb9a51b24970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb011ecd15f7499cb1cc73e4d3287c9a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.196622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1227/2457] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:51 2022] DELETE /identity/v3/users/eb011ecd15f7499cb1cc73e4d3287c9a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:51.488392 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:51.490275 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:51.505544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519b935-1278-4cc5-bb92-8007948da950 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:51.542414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:51.568786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:51.569466 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:51.569780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:51.570055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] PATH_INFO: `/v3/projects/8382781e572345d9ae9ca249e311c881` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:51.571866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8382781e572345d9ae9ca249e311c881)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:51.574090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:51.625488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8382781e572345d9ae9ca249e311c881', 'request_id': 'req-9526a380-1b66-4861-bb0e-38c9beaa39a5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.633239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8382781e572345d9ae9ca249e311c881', 'request_id': 'req-9526a380-1b66-4861-bb0e-38c9beaa39a5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.643621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8382781e572345d9ae9ca249e311c881', 'request_id': 'req-9526a380-1b66-4861-bb0e-38c9beaa39a5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.655637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] The token cache is being invalidate because project 8382781e572345d9ae9ca249e311c881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:51.655929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.656643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9526a380-1b66-4861-bb0e-38c9beaa39a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:51.658330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1231/2458] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:51 2022] DELETE /identity/v3/projects/8382781e572345d9ae9ca249e311c881 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:51.663767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042ef8-bb3e-4f9c-b652-0c1052b2fda2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:51.664222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042ef8-bb3e-4f9c-b652-0c1052b2fda2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:51.664439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042ef8-bb3e-4f9c-b652-0c1052b2fda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:51.686093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-32042ef8-bb3e-4f9c-b652-0c1052b2fda2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:51.687289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-32042ef8-bb3e-4f9c-b652-0c1052b2fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:51.753225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1228/2459] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:51.761786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a9ff-ebd2-44d1-a09d-dd4833a00c32 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:51.762064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a9ff-ebd2-44d1-a09d-dd4833a00c32 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:51.762336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a9ff-ebd2-44d1-a09d-dd4833a00c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:51.782901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-52d1a9ff-ebd2-44d1-a09d-dd4833a00c32 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:51.784118 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-52d1a9ff-ebd2-44d1-a09d-dd4833a00c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:51.793130 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1232/2460] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:51.797701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32042ef8-bb3e-4f9c-b652-0c1052b2fda2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:51.807683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32042ef8-bb3e-4f9c-b652-0c1052b2fda2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:51.813223 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52073-d23d-4b66-b520-7e51fd3a13fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:51.814004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52073-d23d-4b66-b520-7e51fd3a13fc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:51.814375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52073-d23d-4b66-b520-7e51fd3a13fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:51.814734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52073-d23d-4b66-b520-7e51fd3a13fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:51.815531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e52073-d23d-4b66-b520-7e51fd3a13fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:33:51.815973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e52073-d23d-4b66-b520-7e51fd3a13fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:51.817596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e52073-d23d-4b66-b520-7e51fd3a13fc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:51.830873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1229/2461] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:33:51.835387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1a9ff-ebd2-44d1-a09d-dd4833a00c32 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:51.844706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1a9ff-ebd2-44d1-a09d-dd4833a00c32 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:51.849949 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481cb4a-9539-496b-81d9-883028f06227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:51.850571 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481cb4a-9539-496b-81d9-883028f06227 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:51.850843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481cb4a-9539-496b-81d9-883028f06227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:51.851172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481cb4a-9539-496b-81d9-883028f06227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:51.851852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481cb4a-9539-496b-81d9-883028f06227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:51.853842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481cb4a-9539-496b-81d9-883028f06227 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:51.882061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1233/2462] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:51 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:51.886533 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52073-d23d-4b66-b520-7e51fd3a13fc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:51.896762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52073-d23d-4b66-b520-7e51fd3a13fc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:51.947833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:51.959944 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458afd9-92f7-4f7c-b9bf-7614e597f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:51.960682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458afd9-92f7-4f7c-b9bf-7614e597f42d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:51.960972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458afd9-92f7-4f7c-b9bf-7614e597f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:51.961250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458afd9-92f7-4f7c-b9bf-7614e597f42d admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:51.961973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458afd9-92f7-4f7c-b9bf-7614e597f42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:51.963942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458afd9-92f7-4f7c-b9bf-7614e597f42d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:51.988902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1230/2463] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:51 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:51.993293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481cb4a-9539-496b-81d9-883028f06227 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.005875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481cb4a-9539-496b-81d9-883028f06227 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.013207 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27d0a-21d6-4e77-8d19-5a76706a921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.013885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27d0a-21d6-4e77-8d19-5a76706a921c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.014162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27d0a-21d6-4e77-8d19-5a76706a921c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.014509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27d0a-21d6-4e77-8d19-5a76706a921c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.015226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b27d0a-21d6-4e77-8d19-5a76706a921c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:52.017144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b27d0a-21d6-4e77-8d19-5a76706a921c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:52.031289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1234/2464] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:52.042661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458afd9-92f7-4f7c-b9bf-7614e597f42d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.055017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458afd9-92f7-4f7c-b9bf-7614e597f42d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.060328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac2018-2390-4c37-a0d7-02292cd8d93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.061064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac2018-2390-4c37-a0d7-02292cd8d93c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.061493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac2018-2390-4c37-a0d7-02292cd8d93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.061821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac2018-2390-4c37-a0d7-02292cd8d93c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.063048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac2018-2390-4c37-a0d7-02292cd8d93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:52.064341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac2018-2390-4c37-a0d7-02292cd8d93c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:52.077024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1231/2465] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:52.081674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27d0a-21d6-4e77-8d19-5a76706a921c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.094935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27d0a-21d6-4e77-8d19-5a76706a921c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.102537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae868-898b-4f72-b2a4-9110b88d77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.103813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae868-898b-4f72-b2a4-9110b88d77db admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.103813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae868-898b-4f72-b2a4-9110b88d77db admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.104018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae868-898b-4f72-b2a4-9110b88d77db admin admin] PATH_INFO: `/v3/projects/0ceaf5e7c2654e638b61b3c6b3014c3c/users/5ec8400fded34a5abd3f23e3e4315198/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.122054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae868-898b-4f72-b2a4-9110b88d77db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ceaf5e7c2654e638b61b3c6b3014c3c, user_id=5ec8400fded34a5abd3f23e3e4315198, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:52.125319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae868-898b-4f72-b2a4-9110b88d77db admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:52.143898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1235/2466] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:52 2022] PUT /identity/v3/projects/0ceaf5e7c2654e638b61b3c6b3014c3c/users/5ec8400fded34a5abd3f23e3e4315198/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:52.157044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c9a78-59a3-4844-b20e-d76ef6b29bbe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.157591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c9a78-59a3-4844-b20e-d76ef6b29bbe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.157957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c9a78-59a3-4844-b20e-d76ef6b29bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.189519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e80c9a78-59a3-4844-b20e-d76ef6b29bbe None None] MFA Rules not processed for user `5ec8400fded34a5abd3f23e3e4315198`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:52.190761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e80c9a78-59a3-4844-b20e-d76ef6b29bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:52.281812 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1232/2467] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:52.291283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae868-898b-4f72-b2a4-9110b88d77db admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.363090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae868-898b-4f72-b2a4-9110b88d77db admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.368121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27e7b8-2745-43ee-821a-809e745b4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.368785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27e7b8-2745-43ee-821a-809e745b4690 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.369068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27e7b8-2745-43ee-821a-809e745b4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.369378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27e7b8-2745-43ee-821a-809e745b4690 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.370068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27e7b8-2745-43ee-821a-809e745b4690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:52.372086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27e7b8-2745-43ee-821a-809e745b4690 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:52.377770 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:52.400881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1236/2468] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:52 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:52.405288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c9a78-59a3-4844-b20e-d76ef6b29bbe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.418640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c9a78-59a3-4844-b20e-d76ef6b29bbe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.505321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecb44f-4610-400d-8553-6ffe9f87d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.506231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb44f-4610-400d-8553-6ffe9f87d35d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.507291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb44f-4610-400d-8553-6ffe9f87d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.507291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb44f-4610-400d-8553-6ffe9f87d35d admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.507686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecb44f-4610-400d-8553-6ffe9f87d35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:52.509691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecb44f-4610-400d-8553-6ffe9f87d35d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:52.569255 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1233/2469] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:52 2022] POST /identity/v3/users => generated 306 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:52.574848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27e7b8-2745-43ee-821a-809e745b4690 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.586962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27e7b8-2745-43ee-821a-809e745b4690 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.598162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba982113-6832-4195-ad10-c441d4f8ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.598898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba982113-6832-4195-ad10-c441d4f8ee4b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.599152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba982113-6832-4195-ad10-c441d4f8ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.601640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba982113-6832-4195-ad10-c441d4f8ee4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.601640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba982113-6832-4195-ad10-c441d4f8ee4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:52.602360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba982113-6832-4195-ad10-c441d4f8ee4b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:52.613693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1237/2470] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:52.618248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecb44f-4610-400d-8553-6ffe9f87d35d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.631555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecb44f-4610-400d-8553-6ffe9f87d35d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.638136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb286c9-c27b-462c-8e75-06ee3df00e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.638916 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb286c9-c27b-462c-8e75-06ee3df00e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.639197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb286c9-c27b-462c-8e75-06ee3df00e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.639467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb286c9-c27b-462c-8e75-06ee3df00e53 admin admin] PATH_INFO: `/v3/projects/c4932a7103c141f2902607c6309b28da/users/42cfb0d7c0064077ba89532dbb5713a8/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.656377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb286c9-c27b-462c-8e75-06ee3df00e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4932a7103c141f2902607c6309b28da, user_id=42cfb0d7c0064077ba89532dbb5713a8, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:52.659060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb286c9-c27b-462c-8e75-06ee3df00e53 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:52.674020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1234/2471] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:52 2022] PUT /identity/v3/projects/c4932a7103c141f2902607c6309b28da/users/42cfb0d7c0064077ba89532dbb5713a8/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:52.678465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba982113-6832-4195-ad10-c441d4f8ee4b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.688928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba982113-6832-4195-ad10-c441d4f8ee4b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.746437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1b736-cc81-4688-9ee0-46088a17e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.747075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1b736-cc81-4688-9ee0-46088a17e99f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.747346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1b736-cc81-4688-9ee0-46088a17e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.747610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1b736-cc81-4688-9ee0-46088a17e99f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.748356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1b736-cc81-4688-9ee0-46088a17e99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:52.750151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1b736-cc81-4688-9ee0-46088a17e99f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:52.761079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1238/2472] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:52.765773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb286c9-c27b-462c-8e75-06ee3df00e53 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.777022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb286c9-c27b-462c-8e75-06ee3df00e53 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.782605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872cb42-b0b0-4c84-a1ab-1cdce988c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.783338 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872cb42-b0b0-4c84-a1ab-1cdce988c84f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.783614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872cb42-b0b0-4c84-a1ab-1cdce988c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.783882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872cb42-b0b0-4c84-a1ab-1cdce988c84f admin admin] PATH_INFO: `/v3/projects/c4932a7103c141f2902607c6309b28da/users/42cfb0d7c0064077ba89532dbb5713a8/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.786013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872cb42-b0b0-4c84-a1ab-1cdce988c84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4932a7103c141f2902607c6309b28da, user_id=42cfb0d7c0064077ba89532dbb5713a8, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:52.788845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872cb42-b0b0-4c84-a1ab-1cdce988c84f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:52.800273 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1235/2473] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:52 2022] PUT /identity/v3/projects/c4932a7103c141f2902607c6309b28da/users/42cfb0d7c0064077ba89532dbb5713a8/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:52.810814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1783e1a-e240-4cc6-baa8-be63b08dfae1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.811105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1783e1a-e240-4cc6-baa8-be63b08dfae1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:52.811382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1783e1a-e240-4cc6-baa8-be63b08dfae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:52.841078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e1783e1a-e240-4cc6-baa8-be63b08dfae1 None None] MFA Rules not processed for user `42cfb0d7c0064077ba89532dbb5713a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:52.842590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e1783e1a-e240-4cc6-baa8-be63b08dfae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:52.917042 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1239/2474] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:52.928075 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872cb42-b0b0-4c84-a1ab-1cdce988c84f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:52.930021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4872cb42-b0b0-4c84-a1ab-1cdce988c84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:52.946522 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:52.994814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872cb42-b0b0-4c84-a1ab-1cdce988c84f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:52.999008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867488d6-7c97-4a59-99bc-e0e211b8827e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:52.999670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867488d6-7c97-4a59-99bc-e0e211b8827e service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:52.999948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867488d6-7c97-4a59-99bc-e0e211b8827e service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:53.000232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867488d6-7c97-4a59-99bc-e0e211b8827e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:53.010039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867488d6-7c97-4a59-99bc-e0e211b8827e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:53.011491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867488d6-7c97-4a59-99bc-e0e211b8827e service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:53.021602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1236/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:53.103254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1783e1a-e240-4cc6-baa8-be63b08dfae1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:53.113901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1783e1a-e240-4cc6-baa8-be63b08dfae1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:53.117727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494351bc-c675-4c9b-b079-4501fafb25d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:53.118373 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494351bc-c675-4c9b-b079-4501fafb25d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:53.119370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494351bc-c675-4c9b-b079-4501fafb25d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:53.119652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494351bc-c675-4c9b-b079-4501fafb25d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:53.187020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:53.189817 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494351bc-c675-4c9b-b079-4501fafb25d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:53.194060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494351bc-c675-4c9b-b079-4501fafb25d9 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:53.204735 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1240/2476] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:56.951642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d455c72-2816-4114-8c54-42105abe3937 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:56.952161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d455c72-2816-4114-8c54-42105abe3937 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:56.952246 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d455c72-2816-4114-8c54-42105abe3937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:56.975132 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3d455c72-2816-4114-8c54-42105abe3937 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:56.976374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3d455c72-2816-4114-8c54-42105abe3937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:57.040424 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1237/2477] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 26 07:33:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:57.055635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494351bc-c675-4c9b-b079-4501fafb25d9 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:57.057458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-494351bc-c675-4c9b-b079-4501fafb25d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:57.131699 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494351bc-c675-4c9b-b079-4501fafb25d9 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:57.136877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b8c9d-3963-4658-9dbb-35a9432a1445 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:57.137551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b8c9d-3963-4658-9dbb-35a9432a1445 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:57.137828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b8c9d-3963-4658-9dbb-35a9432a1445 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:57.138096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b8c9d-3963-4658-9dbb-35a9432a1445 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:57.151261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b8c9d-3963-4658-9dbb-35a9432a1445 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:57.152993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b8c9d-3963-4658-9dbb-35a9432a1445 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:57.162265 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1241/2478] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:33:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:33:57.680243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d455c72-2816-4114-8c54-42105abe3937 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:57.749404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d455c72-2816-4114-8c54-42105abe3937 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:57.754849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:57.755540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:57.755820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:57.756098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] PATH_INFO: `/v3/users/5ec8400fded34a5abd3f23e3e4315198` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:57.757469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec8400fded34a5abd3f23e3e4315198)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:57.759545 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:57.814305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec8400fded34a5abd3f23e3e4315198'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:57.821673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec8400fded34a5abd3f23e3e4315198'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:57.831366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:57.839293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec8400fded34a5abd3f23e3e4315198'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:57.847430 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec8400fded34a5abd3f23e3e4315198'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:57.848167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec8400fded34a5abd3f23e3e4315198'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:57.854604 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1238/2479] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:57 2022] DELETE /identity/v3/users/5ec8400fded34a5abd3f23e3e4315198 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:57.859164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080dfb-630b-489f-8af9-e9560917a6fb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:57.859453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080dfb-630b-489f-8af9-e9560917a6fb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:57.859732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080dfb-630b-489f-8af9-e9560917a6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:57.884448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-45080dfb-630b-489f-8af9-e9560917a6fb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:57.886138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-45080dfb-630b-489f-8af9-e9560917a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:57.954880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1242/2480] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:57.964984 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:57.966544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:58.023837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04747a-64d8-47e1-a8ec-2a054e49b94e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:58.028155 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ead94-72e0-4840-8fba-cc647af3c1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:58.028800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ead94-72e0-4840-8fba-cc647af3c1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:58.029103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ead94-72e0-4840-8fba-cc647af3c1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:58.029415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ead94-72e0-4840-8fba-cc647af3c1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:58.040346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ead94-72e0-4840-8fba-cc647af3c1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:58.041884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ead94-72e0-4840-8fba-cc647af3c1d4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:58.051588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1239/2481] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:33:58.345989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45080dfb-630b-489f-8af9-e9560917a6fb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:58.347551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-45080dfb-630b-489f-8af9-e9560917a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:58.360964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45080dfb-630b-489f-8af9-e9560917a6fb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:58.366726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:58.367500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:58.367872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:58.368194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] PATH_INFO: `/v3/projects/0ceaf5e7c2654e638b61b3c6b3014c3c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:58.370714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ceaf5e7c2654e638b61b3c6b3014c3c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:58.373149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:58.443596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ceaf5e7c2654e638b61b3c6b3014c3c', 'request_id': 'req-751fc168-04ba-4751-b3da-331fee078922'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.455516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ceaf5e7c2654e638b61b3c6b3014c3c', 'request_id': 'req-751fc168-04ba-4751-b3da-331fee078922'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.462557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ceaf5e7c2654e638b61b3c6b3014c3c', 'request_id': 'req-751fc168-04ba-4751-b3da-331fee078922'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.474855 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] The token cache is being invalidate because project 0ceaf5e7c2654e638b61b3c6b3014c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:58.475154 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.476055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.477681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1243/2482] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:58 2022] DELETE /identity/v3/projects/0ceaf5e7c2654e638b61b3c6b3014c3c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:58.482750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ead94-72e0-4840-8fba-cc647af3c1d4 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:58.495398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ead94-72e0-4840-8fba-cc647af3c1d4 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:58.581319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:58.582192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:58.582479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:58.582903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] PATH_INFO: `/v3/users/42cfb0d7c0064077ba89532dbb5713a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:58.585990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42cfb0d7c0064077ba89532dbb5713a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:58.588640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:58.662709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42cfb0d7c0064077ba89532dbb5713a8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.672757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42cfb0d7c0064077ba89532dbb5713a8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.688046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42cfb0d7c0064077ba89532dbb5713a8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.709979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42cfb0d7c0064077ba89532dbb5713a8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.710955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-142a4f48-bcd9-4ea1-a337-085ddcf258b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42cfb0d7c0064077ba89532dbb5713a8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:58.717695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1240/2483] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:33:58 2022] DELETE /identity/v3/users/42cfb0d7c0064077ba89532dbb5713a8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:59.017587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:59.019116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:59.039448 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fc168-04ba-4751-b3da-331fee078922 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:59.051976 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:59.141201 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:59.142025 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.142310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.142632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] PATH_INFO: `/v3/projects/c4932a7103c141f2902607c6309b28da` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.143824 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4932a7103c141f2902607c6309b28da)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:59.146567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:59.208040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4932a7103c141f2902607c6309b28da', 'request_id': 'req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:59.217035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4932a7103c141f2902607c6309b28da', 'request_id': 'req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:59.223020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4932a7103c141f2902607c6309b28da', 'request_id': 'req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:59.243826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] The token cache is being invalidate because project c4932a7103c141f2902607c6309b28da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:33:59.244111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:59.244846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5a0e8078-c625-4fdd-9283-cbf89c72dfe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:33:59.246693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1244/2484] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:33:59 2022] DELETE /identity/v3/projects/c4932a7103c141f2902607c6309b28da => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:59.251566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ea776-dde9-44f8-bbeb-a6f4c9800cc3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.252072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ea776-dde9-44f8-bbeb-a6f4c9800cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.252190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ea776-dde9-44f8-bbeb-a6f4c9800cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.259959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:59.275258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-693ea776-dde9-44f8-bbeb-a6f4c9800cc3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:59.276497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-693ea776-dde9-44f8-bbeb-a6f4c9800cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:59.336556 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1241/2485] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:59.345176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86814e-de2e-45ff-bbc1-9accac011316 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.345489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86814e-de2e-45ff-bbc1-9accac011316 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.345753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86814e-de2e-45ff-bbc1-9accac011316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.366912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-da86814e-de2e-45ff-bbc1-9accac011316 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:59.368223 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-da86814e-de2e-45ff-bbc1-9accac011316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:59.377544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1245/2486] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:59.382646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ea776-dde9-44f8-bbeb-a6f4c9800cc3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:59.393711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ea776-dde9-44f8-bbeb-a6f4c9800cc3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:59.399800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f104b-7dc9-4655-8350-66b018182a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:59.400434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f104b-7dc9-4655-8350-66b018182a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.400719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f104b-7dc9-4655-8350-66b018182a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.400991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f104b-7dc9-4655-8350-66b018182a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.401734 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f104b-7dc9-4655-8350-66b018182a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:33:59.402042 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f104b-7dc9-4655-8350-66b018182a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:59.403674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f104b-7dc9-4655-8350-66b018182a5d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:59.419108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1242/2487] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:33:59.422243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86814e-de2e-45ff-bbc1-9accac011316 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:59.432263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86814e-de2e-45ff-bbc1-9accac011316 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:59.438362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df96e6-5c74-4c23-b4bb-d81b8347f40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:59.439240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df96e6-5c74-4c23-b4bb-d81b8347f40d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.439503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df96e6-5c74-4c23-b4bb-d81b8347f40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.439893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df96e6-5c74-4c23-b4bb-d81b8347f40d admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.440747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df96e6-5c74-4c23-b4bb-d81b8347f40d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:59.442861 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df96e6-5c74-4c23-b4bb-d81b8347f40d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:59.472841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1246/2488] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:59 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:33:59.477448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f104b-7dc9-4655-8350-66b018182a5d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:59.488787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f104b-7dc9-4655-8350-66b018182a5d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:59.553629 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a6480-56de-47bd-b6ba-3316d4b60237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:59.554278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a6480-56de-47bd-b6ba-3316d4b60237 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.554559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a6480-56de-47bd-b6ba-3316d4b60237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.555405 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a6480-56de-47bd-b6ba-3316d4b60237 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.556560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a6480-56de-47bd-b6ba-3316d4b60237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:59.559618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a6480-56de-47bd-b6ba-3316d4b60237 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:59.593798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1243/2489] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:59 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:33:59.595145 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df96e6-5c74-4c23-b4bb-d81b8347f40d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:59.606399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df96e6-5c74-4c23-b4bb-d81b8347f40d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:59.611452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caca87-8cb0-410a-ad18-ae377d74e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:59.612075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caca87-8cb0-410a-ad18-ae377d74e57c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.612373 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caca87-8cb0-410a-ad18-ae377d74e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.612631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caca87-8cb0-410a-ad18-ae377d74e57c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.613366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caca87-8cb0-410a-ad18-ae377d74e57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:59.615012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caca87-8cb0-410a-ad18-ae377d74e57c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:59.625650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1247/2490] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:59.629861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a6480-56de-47bd-b6ba-3316d4b60237 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:59.641071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a6480-56de-47bd-b6ba-3316d4b60237 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:59.647003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34992004-4203-4edb-a916-09441d058dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:59.647645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34992004-4203-4edb-a916-09441d058dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.647931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34992004-4203-4edb-a916-09441d058dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.648211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34992004-4203-4edb-a916-09441d058dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.648977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34992004-4203-4edb-a916-09441d058dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:59.650654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34992004-4203-4edb-a916-09441d058dd9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:59.663079 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1244/2491] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:33:59.668222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caca87-8cb0-410a-ad18-ae377d74e57c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:59.679367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caca87-8cb0-410a-ad18-ae377d74e57c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:59.684459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d265c6-ff0e-4b62-b3cc-4b95f1043107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:59.685141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d265c6-ff0e-4b62-b3cc-4b95f1043107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.685439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d265c6-ff0e-4b62-b3cc-4b95f1043107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.685710 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d265c6-ff0e-4b62-b3cc-4b95f1043107 admin admin] PATH_INFO: `/v3/projects/de4e4abb2c53448a8307365c14b3b2d8/users/c0933f1dc3084d4bb68287218cf2d445/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.708073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d265c6-ff0e-4b62-b3cc-4b95f1043107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4e4abb2c53448a8307365c14b3b2d8, user_id=c0933f1dc3084d4bb68287218cf2d445, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:59.711027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d265c6-ff0e-4b62-b3cc-4b95f1043107 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:59.727899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1248/2492] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:33:59 2022] PUT /identity/v3/projects/de4e4abb2c53448a8307365c14b3b2d8/users/c0933f1dc3084d4bb68287218cf2d445/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:33:59.739644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e252-3876-493c-a29e-80539ff26111 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.739931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e252-3876-493c-a29e-80539ff26111 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.740205 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e252-3876-493c-a29e-80539ff26111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.771585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1d53e252-3876-493c-a29e-80539ff26111 None None] MFA Rules not processed for user `c0933f1dc3084d4bb68287218cf2d445`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:33:59.772822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1d53e252-3876-493c-a29e-80539ff26111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:33:59.840704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:59.848098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1245/2493] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:33:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:33:59.852780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d265c6-ff0e-4b62-b3cc-4b95f1043107 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:59.896870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:33:59.924959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d265c6-ff0e-4b62-b3cc-4b95f1043107 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:33:59.930159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fff77-5d07-426a-b3e8-e6bf63df96fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:33:59.930823 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fff77-5d07-426a-b3e8-e6bf63df96fc admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:33:59.931105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fff77-5d07-426a-b3e8-e6bf63df96fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:33:59.931380 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fff77-5d07-426a-b3e8-e6bf63df96fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:33:59.932093 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fff77-5d07-426a-b3e8-e6bf63df96fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:33:59.934113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fff77-5d07-426a-b3e8-e6bf63df96fc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:33:59.971232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1249/2494] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:33:59 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:33:59.972540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53e252-3876-493c-a29e-80539ff26111 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:33:59.985241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53e252-3876-493c-a29e-80539ff26111 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:00.056170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d8a9a-6fd8-4ff7-91cc-fd18aa64df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:00.056890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d8a9a-6fd8-4ff7-91cc-fd18aa64df56 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:00.057127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d8a9a-6fd8-4ff7-91cc-fd18aa64df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:00.057449 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d8a9a-6fd8-4ff7-91cc-fd18aa64df56 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:00.058175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d8a9a-6fd8-4ff7-91cc-fd18aa64df56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:00.060623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d8a9a-6fd8-4ff7-91cc-fd18aa64df56 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:00.085282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1246/2495] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:33:59 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:34:00.089768 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fff77-5d07-426a-b3e8-e6bf63df96fc admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:00.100370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fff77-5d07-426a-b3e8-e6bf63df96fc admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:00.105414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1593-993b-4ca0-a541-447189470db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:00.106061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1593-993b-4ca0-a541-447189470db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:00.106344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1593-993b-4ca0-a541-447189470db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:00.106695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1593-993b-4ca0-a541-447189470db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:00.107629 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b1593-993b-4ca0-a541-447189470db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:00.109602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b1593-993b-4ca0-a541-447189470db0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:00.123497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1250/2496] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:00.128204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d8a9a-6fd8-4ff7-91cc-fd18aa64df56 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:00.139318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d8a9a-6fd8-4ff7-91cc-fd18aa64df56 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:00.145904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8b08f-d10e-45a4-990b-f66b89dc1289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:00.146647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8b08f-d10e-45a4-990b-f66b89dc1289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:00.147065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8b08f-d10e-45a4-990b-f66b89dc1289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:00.147402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8b08f-d10e-45a4-990b-f66b89dc1289 admin admin] PATH_INFO: `/v3/projects/390f03e7e2234405a1e2bbc3b8730efc/users/01738ec49d894be585c616bfaac41b35/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:00.165290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8b08f-d10e-45a4-990b-f66b89dc1289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390f03e7e2234405a1e2bbc3b8730efc, user_id=01738ec49d894be585c616bfaac41b35, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:00.168322 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8b08f-d10e-45a4-990b-f66b89dc1289 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:00.183852 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1247/2497] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:00 2022] PUT /identity/v3/projects/390f03e7e2234405a1e2bbc3b8730efc/users/01738ec49d894be585c616bfaac41b35/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:00.187813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1593-993b-4ca0-a541-447189470db0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:00.199871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1593-993b-4ca0-a541-447189470db0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:00.259720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dfea2-4594-46f9-825d-f6327e8b1c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:00.260440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dfea2-4594-46f9-825d-f6327e8b1c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:00.260798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dfea2-4594-46f9-825d-f6327e8b1c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:00.261120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dfea2-4594-46f9-825d-f6327e8b1c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:00.262711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dfea2-4594-46f9-825d-f6327e8b1c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:00.264544 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dfea2-4594-46f9-825d-f6327e8b1c8d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:00.276416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1251/2498] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:00.280865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8b08f-d10e-45a4-990b-f66b89dc1289 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:00.291790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8b08f-d10e-45a4-990b-f66b89dc1289 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:00.297790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a066-b459-4485-89fb-265ebb99c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:00.303490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a066-b459-4485-89fb-265ebb99c3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:00.303490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a066-b459-4485-89fb-265ebb99c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:00.303490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a066-b459-4485-89fb-265ebb99c3a9 admin admin] PATH_INFO: `/v3/projects/390f03e7e2234405a1e2bbc3b8730efc/users/01738ec49d894be585c616bfaac41b35/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:00.303490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991a066-b459-4485-89fb-265ebb99c3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390f03e7e2234405a1e2bbc3b8730efc, user_id=01738ec49d894be585c616bfaac41b35, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:00.306370 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991a066-b459-4485-89fb-265ebb99c3a9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:00.315665 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1248/2499] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:00 2022] PUT /identity/v3/projects/390f03e7e2234405a1e2bbc3b8730efc/users/01738ec49d894be585c616bfaac41b35/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:00.326947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dd798-6af5-489f-b0c0-305fb93918d8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:00.327221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dd798-6af5-489f-b0c0-305fb93918d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:00.327492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dd798-6af5-489f-b0c0-305fb93918d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:00.362384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-af3dd798-6af5-489f-b0c0-305fb93918d8 None None] MFA Rules not processed for user `01738ec49d894be585c616bfaac41b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:00.363595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-af3dd798-6af5-489f-b0c0-305fb93918d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:00.458165 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1252/2500] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:00.469377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a066-b459-4485-89fb-265ebb99c3a9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:00.471148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c991a066-b459-4485-89fb-265ebb99c3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:00.537054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a066-b459-4485-89fb-265ebb99c3a9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:00.540865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36054254-3921-4ec9-88d1-bd44d8606a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:00.541540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054254-3921-4ec9-88d1-bd44d8606a91 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:00.541867 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054254-3921-4ec9-88d1-bd44d8606a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:00.542091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054254-3921-4ec9-88d1-bd44d8606a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:00.551911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36054254-3921-4ec9-88d1-bd44d8606a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:00.553482 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36054254-3921-4ec9-88d1-bd44d8606a91 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:00.564615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1249/2501] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:01.263940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dd798-6af5-489f-b0c0-305fb93918d8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:01.265720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-af3dd798-6af5-489f-b0c0-305fb93918d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:01.302806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:01.341956 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dd798-6af5-489f-b0c0-305fb93918d8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:01.346826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:01.347609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:01.347747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:01.347989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] PATH_INFO: `/v3/users/144d14a8ff5c4e5082d8d5495738dfa6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:01.349167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144d14a8ff5c4e5082d8d5495738dfa6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:01.351407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:01.357125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36054254-3921-4ec9-88d1-bd44d8606a91 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:01.367780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36054254-3921-4ec9-88d1-bd44d8606a91 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:01.372464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:01.373116 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:01.373434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:01.373709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] PATH_INFO: `/v3/users/c0933f1dc3084d4bb68287218cf2d445` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:01.374883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0933f1dc3084d4bb68287218cf2d445)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:01.376921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:01.401749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144d14a8ff5c4e5082d8d5495738dfa6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.402577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144d14a8ff5c4e5082d8d5495738dfa6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.403319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144d14a8ff5c4e5082d8d5495738dfa6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.417171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144d14a8ff5c4e5082d8d5495738dfa6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.425340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31becdd5-4d5e-4088-9133-a7a46b460d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144d14a8ff5c4e5082d8d5495738dfa6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.434903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0933f1dc3084d4bb68287218cf2d445'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.436568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:01.438414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1253/2502] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:01 2022] DELETE /identity/v3/users/144d14a8ff5c4e5082d8d5495738dfa6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:01.443260 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7066ba-5e4b-4cde-8844-460b03a68c2f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:01.443623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7066ba-5e4b-4cde-8844-460b03a68c2f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:01.443915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7066ba-5e4b-4cde-8844-460b03a68c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:01.444589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0933f1dc3084d4bb68287218cf2d445'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.459162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0933f1dc3084d4bb68287218cf2d445'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.464913 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fa7066ba-5e4b-4cde-8844-460b03a68c2f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:01.466512 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fa7066ba-5e4b-4cde-8844-460b03a68c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:01.470076 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0933f1dc3084d4bb68287218cf2d445'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.471024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a9dedf2-0273-45c8-a89f-a92c8b19c05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0933f1dc3084d4bb68287218cf2d445'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:01.481025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1250/2503] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:01 2022] DELETE /identity/v3/users/c0933f1dc3084d4bb68287218cf2d445 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:01.483159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197bd4-7618-4838-b5c0-48df6bbfc2a1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:01.483499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197bd4-7618-4838-b5c0-48df6bbfc2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:01.483928 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197bd4-7618-4838-b5c0-48df6bbfc2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:01.506679 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fe197bd4-7618-4838-b5c0-48df6bbfc2a1 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:01.507966 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe197bd4-7618-4838-b5c0-48df6bbfc2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:01.533873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1254/2504] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:01.543604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7066ba-5e4b-4cde-8844-460b03a68c2f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:01.545035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fa7066ba-5e4b-4cde-8844-460b03a68c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:01.588215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1251/2505] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:01.598335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197bd4-7618-4838-b5c0-48df6bbfc2a1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:01.599817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe197bd4-7618-4838-b5c0-48df6bbfc2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:01.629670 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7066ba-5e4b-4cde-8844-460b03a68c2f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:01.634004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:01.678609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197bd4-7618-4838-b5c0-48df6bbfc2a1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:01.682595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04a40-df3c-44cb-bdec-f628bb6e16f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:01.683234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04a40-df3c-44cb-bdec-f628bb6e16f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:01.683521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04a40-df3c-44cb-bdec-f628bb6e16f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:01.683793 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04a40-df3c-44cb-bdec-f628bb6e16f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:01.694114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04a40-df3c-44cb-bdec-f628bb6e16f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:01.694311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1055efb-b49e-4283-baaa-f06be0304bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:01.695137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1055efb-b49e-4283-baaa-f06be0304bfc service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:01.696028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1055efb-b49e-4283-baaa-f06be0304bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:01.696392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04a40-df3c-44cb-bdec-f628bb6e16f8 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:01.696789 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1055efb-b49e-4283-baaa-f06be0304bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:01.706942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1055efb-b49e-4283-baaa-f06be0304bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:01.707616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1252/2506] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:34:01.710406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1055efb-b49e-4283-baaa-f06be0304bfc service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:01.723860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1255/2507] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:34:02.017844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04a40-df3c-44cb-bdec-f628bb6e16f8 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:02.019994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-48c04a40-df3c-44cb-bdec-f628bb6e16f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:02.039548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1055efb-b49e-4283-baaa-f06be0304bfc service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:02.041294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e1055efb-b49e-4283-baaa-f06be0304bfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:02.047589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04a40-df3c-44cb-bdec-f628bb6e16f8 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:02.056552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:02.057628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:02.057848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:02.058185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] PATH_INFO: `/v3/projects/de4e4abb2c53448a8307365c14b3b2d8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:02.059438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4e4abb2c53448a8307365c14b3b2d8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:02.060323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1055efb-b49e-4283-baaa-f06be0304bfc service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:02.061693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:02.072594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:02.073426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:02.073859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:02.074252 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] PATH_INFO: `/v3/projects/c6e9f830bd3545ea8cd0ffc8ade16672` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:02.076179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e9f830bd3545ea8cd0ffc8ade16672)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:02.078179 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:02.115496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4e4abb2c53448a8307365c14b3b2d8', 'request_id': 'req-a0589e5e-16cd-4938-96d5-767e1c565175'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.122851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4e4abb2c53448a8307365c14b3b2d8', 'request_id': 'req-a0589e5e-16cd-4938-96d5-767e1c565175'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.127986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:02.128679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e9f830bd3545ea8cd0ffc8ade16672', 'request_id': 'req-8d8ab677-cb37-4565-abb8-055612985301'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.129755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4e4abb2c53448a8307365c14b3b2d8', 'request_id': 'req-a0589e5e-16cd-4938-96d5-767e1c565175'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.138188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e9f830bd3545ea8cd0ffc8ade16672', 'request_id': 'req-8d8ab677-cb37-4565-abb8-055612985301'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.144402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] The token cache is being invalidate because project de4e4abb2c53448a8307365c14b3b2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:02.144402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.145288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.145805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e9f830bd3545ea8cd0ffc8ade16672', 'request_id': 'req-8d8ab677-cb37-4565-abb8-055612985301'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.147070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1253/2508] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:02 2022] DELETE /identity/v3/projects/de4e4abb2c53448a8307365c14b3b2d8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:02.151399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:02.152810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:02.158326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] The token cache is being invalidate because project c6e9f830bd3545ea8cd0ffc8ade16672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:02.158621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.159308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.160898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1256/2509] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:02 2022] DELETE /identity/v3/projects/c6e9f830bd3545ea8cd0ffc8ade16672 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:02.226809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0589e5e-16cd-4938-96d5-767e1c565175 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:02.291170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:02.291794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:02.292039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:02.292328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] PATH_INFO: `/v3/users/01738ec49d894be585c616bfaac41b35` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:02.293651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01738ec49d894be585c616bfaac41b35)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:02.295638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:02.350554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01738ec49d894be585c616bfaac41b35'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.359362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01738ec49d894be585c616bfaac41b35'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.373104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01738ec49d894be585c616bfaac41b35'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.380802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01738ec49d894be585c616bfaac41b35'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.381605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01738ec49d894be585c616bfaac41b35'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:02.389354 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1254/2510] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:02 2022] DELETE /identity/v3/users/01738ec49d894be585c616bfaac41b35 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:02.899850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:02.901628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:02.928534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:02.930250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:02.954056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:02.975783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ab677-cb37-4565-abb8-055612985301 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.005471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78f1b9-e2ee-4299-b097-ab8a8ca4fd7f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.010134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.010819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.011098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.011372 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] PATH_INFO: `/v3/projects/390f03e7e2234405a1e2bbc3b8730efc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.012526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390f03e7e2234405a1e2bbc3b8730efc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.014489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.023980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:03.029467 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b43fb-1c9b-41a9-992a-ba4b0d099069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.030113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b43fb-1c9b-41a9-992a-ba4b0d099069 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.030471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b43fb-1c9b-41a9-992a-ba4b0d099069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.030740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b43fb-1c9b-41a9-992a-ba4b0d099069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.032999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aa6b43fb-1c9b-41a9-992a-ba4b0d099069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:03.049206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b43fb-1c9b-41a9-992a-ba4b0d099069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.050705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b43fb-1c9b-41a9-992a-ba4b0d099069 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.061197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1257/2511] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:03.066930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390f03e7e2234405a1e2bbc3b8730efc', 'request_id': 'req-970b56cc-a5a4-4efd-aff3-07bcee016a83'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:03.077379 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390f03e7e2234405a1e2bbc3b8730efc', 'request_id': 'req-970b56cc-a5a4-4efd-aff3-07bcee016a83'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:03.085243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390f03e7e2234405a1e2bbc3b8730efc', 'request_id': 'req-970b56cc-a5a4-4efd-aff3-07bcee016a83'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:03.097102 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] The token cache is being invalidate because project 390f03e7e2234405a1e2bbc3b8730efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:03.097388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:03.098051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-970b56cc-a5a4-4efd-aff3-07bcee016a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:03.099601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1255/2512] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:02 2022] DELETE /identity/v3/projects/390f03e7e2234405a1e2bbc3b8730efc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:03.104703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abf633-3948-4954-8fd3-ef1f865c782d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.104990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abf633-3948-4954-8fd3-ef1f865c782d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.105284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abf633-3948-4954-8fd3-ef1f865c782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.125098 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-55abf633-3948-4954-8fd3-ef1f865c782d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:03.126343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-55abf633-3948-4954-8fd3-ef1f865c782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:03.189778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1258/2513] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:03.198528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e789aa-4359-450f-bf83-f81adfbc47b3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.198809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e789aa-4359-450f-bf83-f81adfbc47b3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.199078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e789aa-4359-450f-bf83-f81adfbc47b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.220628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a3e789aa-4359-450f-bf83-f81adfbc47b3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:03.221921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a3e789aa-4359-450f-bf83-f81adfbc47b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:03.231020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1256/2514] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:03.235743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abf633-3948-4954-8fd3-ef1f865c782d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.246274 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abf633-3948-4954-8fd3-ef1f865c782d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.251021 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cee19-8222-4e15-a869-58658f47162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.251650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cee19-8222-4e15-a869-58658f47162c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.251944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cee19-8222-4e15-a869-58658f47162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.252213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cee19-8222-4e15-a869-58658f47162c admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.252908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cee19-8222-4e15-a869-58658f47162c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:34:03.253224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cee19-8222-4e15-a869-58658f47162c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.254892 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cee19-8222-4e15-a869-58658f47162c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.267396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1259/2515] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:34:03.271897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e789aa-4359-450f-bf83-f81adfbc47b3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.281499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e789aa-4359-450f-bf83-f81adfbc47b3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.286315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe7a3-ee2b-4d83-8f23-da5d0dc9aab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.286935 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe7a3-ee2b-4d83-8f23-da5d0dc9aab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.287223 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe7a3-ee2b-4d83-8f23-da5d0dc9aab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.287497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe7a3-ee2b-4d83-8f23-da5d0dc9aab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.288288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe7a3-ee2b-4d83-8f23-da5d0dc9aab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.290259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe7a3-ee2b-4d83-8f23-da5d0dc9aab2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.320341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1257/2516] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:03 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:03.325119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cee19-8222-4e15-a869-58658f47162c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.335556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cee19-8222-4e15-a869-58658f47162c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.394468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b48f-00e2-4e42-bf08-31e1cee5f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.395106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b48f-00e2-4e42-bf08-31e1cee5f14b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.395388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b48f-00e2-4e42-bf08-31e1cee5f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.395777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b48f-00e2-4e42-bf08-31e1cee5f14b admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.396458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b48f-00e2-4e42-bf08-31e1cee5f14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.398490 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b48f-00e2-4e42-bf08-31e1cee5f14b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.421712 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1260/2517] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:03 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:03.426012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe7a3-ee2b-4d83-8f23-da5d0dc9aab2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.440785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe7a3-ee2b-4d83-8f23-da5d0dc9aab2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.446035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53545d1-9503-4dd4-8a19-6aa0fca2b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.446670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53545d1-9503-4dd4-8a19-6aa0fca2b755 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.446943 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53545d1-9503-4dd4-8a19-6aa0fca2b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.447233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53545d1-9503-4dd4-8a19-6aa0fca2b755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.447932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53545d1-9503-4dd4-8a19-6aa0fca2b755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.449690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53545d1-9503-4dd4-8a19-6aa0fca2b755 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.460506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1258/2518] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:03.464753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b48f-00e2-4e42-bf08-31e1cee5f14b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.475368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b48f-00e2-4e42-bf08-31e1cee5f14b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.480841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6a27-e1b0-4ef8-b2af-a3d73157478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.481509 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6a27-e1b0-4ef8-b2af-a3d73157478d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.481794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6a27-e1b0-4ef8-b2af-a3d73157478d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.482069 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6a27-e1b0-4ef8-b2af-a3d73157478d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.482785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a6a27-e1b0-4ef8-b2af-a3d73157478d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.484412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a6a27-e1b0-4ef8-b2af-a3d73157478d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.496038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1261/2519] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:03.500609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53545d1-9503-4dd4-8a19-6aa0fca2b755 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.511378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53545d1-9503-4dd4-8a19-6aa0fca2b755 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.516222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea01116-fe3f-4247-be6f-49ca65fd032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.516986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea01116-fe3f-4247-be6f-49ca65fd032d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.517358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea01116-fe3f-4247-be6f-49ca65fd032d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.517697 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea01116-fe3f-4247-be6f-49ca65fd032d admin admin] PATH_INFO: `/v3/projects/9e75694649a44f15a0bcf489fe265e10/users/69259c5bbef54d6cb352beb712b677b2/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.533741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea01116-fe3f-4247-be6f-49ca65fd032d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e75694649a44f15a0bcf489fe265e10, user_id=69259c5bbef54d6cb352beb712b677b2, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.536487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea01116-fe3f-4247-be6f-49ca65fd032d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.552131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1259/2520] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:03 2022] PUT /identity/v3/projects/9e75694649a44f15a0bcf489fe265e10/users/69259c5bbef54d6cb352beb712b677b2/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:03.563785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca587-f95e-4738-bc03-bd8dd6eef42e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.564074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca587-f95e-4738-bc03-bd8dd6eef42e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.564353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca587-f95e-4738-bc03-bd8dd6eef42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.592815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5a0ca587-f95e-4738-bc03-bd8dd6eef42e None None] MFA Rules not processed for user `69259c5bbef54d6cb352beb712b677b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:03.594368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5a0ca587-f95e-4738-bc03-bd8dd6eef42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:03.642058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:03.665148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1262/2521] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:03.670070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea01116-fe3f-4247-be6f-49ca65fd032d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.726922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:03.747395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea01116-fe3f-4247-be6f-49ca65fd032d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.752615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7835c7-cb72-4bc0-9cdf-f8df2aee1e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.753375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7835c7-cb72-4bc0-9cdf-f8df2aee1e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.753553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7835c7-cb72-4bc0-9cdf-f8df2aee1e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.753822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7835c7-cb72-4bc0-9cdf-f8df2aee1e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.754555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7835c7-cb72-4bc0-9cdf-f8df2aee1e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.756474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7835c7-cb72-4bc0-9cdf-f8df2aee1e8a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.786814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1260/2522] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:03 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:03.791970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca587-f95e-4738-bc03-bd8dd6eef42e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.804570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca587-f95e-4738-bc03-bd8dd6eef42e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.861836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398955d-0a9f-4f0b-bad6-36ba34543419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.862555 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398955d-0a9f-4f0b-bad6-36ba34543419 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.862848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398955d-0a9f-4f0b-bad6-36ba34543419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.863103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398955d-0a9f-4f0b-bad6-36ba34543419 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.863819 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398955d-0a9f-4f0b-bad6-36ba34543419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.865968 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398955d-0a9f-4f0b-bad6-36ba34543419 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.891300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1263/2523] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:03 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:03.892884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7835c7-cb72-4bc0-9cdf-f8df2aee1e8a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.905152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7835c7-cb72-4bc0-9cdf-f8df2aee1e8a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.910066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf97b8-2d8b-48ef-a8cf-ceb6fc31b32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.910710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf97b8-2d8b-48ef-a8cf-ceb6fc31b32a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.911023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf97b8-2d8b-48ef-a8cf-ceb6fc31b32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.911299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf97b8-2d8b-48ef-a8cf-ceb6fc31b32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.912010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf97b8-2d8b-48ef-a8cf-ceb6fc31b32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.913720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf97b8-2d8b-48ef-a8cf-ceb6fc31b32a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.926000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1261/2524] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:03.930368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398955d-0a9f-4f0b-bad6-36ba34543419 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:03.940706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398955d-0a9f-4f0b-bad6-36ba34543419 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:03.946090 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dc283-ecf0-4274-8015-abf4da4c9a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:03.946664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dc283-ecf0-4274-8015-abf4da4c9a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:03.946944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dc283-ecf0-4274-8015-abf4da4c9a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:03.947220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dc283-ecf0-4274-8015-abf4da4c9a7a admin admin] PATH_INFO: `/v3/projects/075d981abd7949f3b371e3952ecabf9f/users/7e03876c86ff4cf2b1f8961baa5252ce/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:03.969505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dc283-ecf0-4274-8015-abf4da4c9a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=075d981abd7949f3b371e3952ecabf9f, user_id=7e03876c86ff4cf2b1f8961baa5252ce, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:03.972695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dc283-ecf0-4274-8015-abf4da4c9a7a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:03.993330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1264/2525] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:03 2022] PUT /identity/v3/projects/075d981abd7949f3b371e3952ecabf9f/users/7e03876c86ff4cf2b1f8961baa5252ce/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:03.994687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf97b8-2d8b-48ef-a8cf-ceb6fc31b32a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:04.006686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf97b8-2d8b-48ef-a8cf-ceb6fc31b32a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:04.082334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885783a8-6923-45dd-99de-a8fa0bff81dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:04.083154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885783a8-6923-45dd-99de-a8fa0bff81dd admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:04.083539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885783a8-6923-45dd-99de-a8fa0bff81dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:04.083918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885783a8-6923-45dd-99de-a8fa0bff81dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:04.085505 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885783a8-6923-45dd-99de-a8fa0bff81dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:04.087250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885783a8-6923-45dd-99de-a8fa0bff81dd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:04.099820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1262/2526] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:04.104449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dc283-ecf0-4274-8015-abf4da4c9a7a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:04.117186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dc283-ecf0-4274-8015-abf4da4c9a7a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:04.123792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d456ed5-36c0-401f-b8df-05acfda68952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:04.125108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d456ed5-36c0-401f-b8df-05acfda68952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:04.125108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d456ed5-36c0-401f-b8df-05acfda68952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:04.125391 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d456ed5-36c0-401f-b8df-05acfda68952 admin admin] PATH_INFO: `/v3/projects/075d981abd7949f3b371e3952ecabf9f/users/7e03876c86ff4cf2b1f8961baa5252ce/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:04.127616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d456ed5-36c0-401f-b8df-05acfda68952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075d981abd7949f3b371e3952ecabf9f, user_id=7e03876c86ff4cf2b1f8961baa5252ce, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:04.131450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d456ed5-36c0-401f-b8df-05acfda68952 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:04.146942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1265/2527] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:04 2022] PUT /identity/v3/projects/075d981abd7949f3b371e3952ecabf9f/users/7e03876c86ff4cf2b1f8961baa5252ce/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:04.158391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0a349-c370-471d-bc45-adf4d33dceab None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:04.158590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0a349-c370-471d-bc45-adf4d33dceab None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:04.158868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0a349-c370-471d-bc45-adf4d33dceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:04.187631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3cf0a349-c370-471d-bc45-adf4d33dceab None None] MFA Rules not processed for user `7e03876c86ff4cf2b1f8961baa5252ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:04.188877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3cf0a349-c370-471d-bc45-adf4d33dceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:04.260080 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1263/2528] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:04.272027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d456ed5-36c0-401f-b8df-05acfda68952 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:04.274340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4d456ed5-36c0-401f-b8df-05acfda68952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:04.336838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d456ed5-36c0-401f-b8df-05acfda68952 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:04.340742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37088f5d-87fc-48b5-aebe-bf1f97434e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:04.341453 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37088f5d-87fc-48b5-aebe-bf1f97434e27 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:04.341740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37088f5d-87fc-48b5-aebe-bf1f97434e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:04.342010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37088f5d-87fc-48b5-aebe-bf1f97434e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:04.394621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:04.398643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37088f5d-87fc-48b5-aebe-bf1f97434e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:04.400414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37088f5d-87fc-48b5-aebe-bf1f97434e27 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:04.412513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1266/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:06.168429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0a349-c370-471d-bc45-adf4d33dceab None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:06.170046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3cf0a349-c370-471d-bc45-adf4d33dceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:06.218832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:06.230157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37088f5d-87fc-48b5-aebe-bf1f97434e27 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:06.232109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-37088f5d-87fc-48b5-aebe-bf1f97434e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:06.263063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0a349-c370-471d-bc45-adf4d33dceab None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:06.271429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3fc0-3f86-4c09-81c0-ba45619424e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:06.272529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3fc0-3f86-4c09-81c0-ba45619424e6 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:06.274013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3fc0-3f86-4c09-81c0-ba45619424e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:06.274013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3fc0-3f86-4c09-81c0-ba45619424e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:06.276479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-62ac3fc0-3f86-4c09-81c0-ba45619424e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:06.290253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac3fc0-3f86-4c09-81c0-ba45619424e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:06.292085 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac3fc0-3f86-4c09-81c0-ba45619424e6 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:06.305529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1264/2530] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:06.340757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37088f5d-87fc-48b5-aebe-bf1f97434e27 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:06.348290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:06.349026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:06.349305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:06.349573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] PATH_INFO: `/v3/users/b9ece518ba544f5190bb914ccb3fe63d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:06.350836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ece518ba544f5190bb914ccb3fe63d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:06.352836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:06.418091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ece518ba544f5190bb914ccb3fe63d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.419110 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ece518ba544f5190bb914ccb3fe63d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.420012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ece518ba544f5190bb914ccb3fe63d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.435660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ece518ba544f5190bb914ccb3fe63d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.443189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-950e9f94-27ac-4614-86d4-a4bafa85d42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ece518ba544f5190bb914ccb3fe63d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.457124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1267/2531] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:06 2022] DELETE /identity/v3/users/b9ece518ba544f5190bb914ccb3fe63d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:06.657399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3fc0-3f86-4c09-81c0-ba45619424e6 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:06.669190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3fc0-3f86-4c09-81c0-ba45619424e6 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:06.739599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:06.740349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:06.740662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:06.740906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] PATH_INFO: `/v3/projects/28321448013f4228a65f5c279edb40db` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:06.742196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28321448013f4228a65f5c279edb40db)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:06.744279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:06.820123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28321448013f4228a65f5c279edb40db', 'request_id': 'req-70daedf2-7756-4558-937a-12299555a0d2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.830358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28321448013f4228a65f5c279edb40db', 'request_id': 'req-70daedf2-7756-4558-937a-12299555a0d2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.837284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28321448013f4228a65f5c279edb40db', 'request_id': 'req-70daedf2-7756-4558-937a-12299555a0d2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.851315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] The token cache is being invalidate because project 28321448013f4228a65f5c279edb40db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:06.851703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.852643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70daedf2-7756-4558-937a-12299555a0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:06.854448 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1265/2532] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:06 2022] DELETE /identity/v3/projects/28321448013f4228a65f5c279edb40db => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:06.859518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9fc1d-c009-40b6-9422-6cd515bedc08 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:06.859799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9fc1d-c009-40b6-9422-6cd515bedc08 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:06.860230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9fc1d-c009-40b6-9422-6cd515bedc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:06.881294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-90a9fc1d-c009-40b6-9422-6cd515bedc08 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:06.882549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-90a9fc1d-c009-40b6-9422-6cd515bedc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:06.955394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1268/2533] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:06.964849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b66184-44e0-4c75-bd20-3f86a6f04045 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:06.965131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b66184-44e0-4c75-bd20-3f86a6f04045 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:06.965435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b66184-44e0-4c75-bd20-3f86a6f04045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:06.985525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-06b66184-44e0-4c75-bd20-3f86a6f04045 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:06.986750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-06b66184-44e0-4c75-bd20-3f86a6f04045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:06.995553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1266/2534] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:07.000160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9fc1d-c009-40b6-9422-6cd515bedc08 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.010388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9fc1d-c009-40b6-9422-6cd515bedc08 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.015158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1d307-170f-46c0-b2ed-acbec23a06dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.015804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1d307-170f-46c0-b2ed-acbec23a06dd admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.016080 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1d307-170f-46c0-b2ed-acbec23a06dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.016356 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1d307-170f-46c0-b2ed-acbec23a06dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.017096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1d307-170f-46c0-b2ed-acbec23a06dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:34:07.017446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1d307-170f-46c0-b2ed-acbec23a06dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.019072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1d307-170f-46c0-b2ed-acbec23a06dd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.028483 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:07.034671 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1269/2535] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:34:07.036937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b66184-44e0-4c75-bd20-3f86a6f04045 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.047982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b66184-44e0-4c75-bd20-3f86a6f04045 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.053237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adece8c7-0009-427f-85ba-a4dc48d83e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.053907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adece8c7-0009-427f-85ba-a4dc48d83e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.054189 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adece8c7-0009-427f-85ba-a4dc48d83e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.054467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adece8c7-0009-427f-85ba-a4dc48d83e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.055137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adece8c7-0009-427f-85ba-a4dc48d83e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.057321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adece8c7-0009-427f-85ba-a4dc48d83e47 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.095862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1267/2536] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:07 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:07.100541 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1d307-170f-46c0-b2ed-acbec23a06dd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.111982 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1d307-170f-46c0-b2ed-acbec23a06dd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.177946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259967-3abf-49e7-aa78-07202ba62230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.178681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259967-3abf-49e7-aa78-07202ba62230 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.178959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259967-3abf-49e7-aa78-07202ba62230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.179225 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259967-3abf-49e7-aa78-07202ba62230 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.179897 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73259967-3abf-49e7-aa78-07202ba62230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.181900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73259967-3abf-49e7-aa78-07202ba62230 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.209640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1270/2537] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:07 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:07.215265 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adece8c7-0009-427f-85ba-a4dc48d83e47 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.226737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adece8c7-0009-427f-85ba-a4dc48d83e47 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.231756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c4333-3144-42fd-bdd7-a63422db111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.232377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c4333-3144-42fd-bdd7-a63422db111f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.232657 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c4333-3144-42fd-bdd7-a63422db111f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.232933 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c4333-3144-42fd-bdd7-a63422db111f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.233674 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c4333-3144-42fd-bdd7-a63422db111f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.235288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c4333-3144-42fd-bdd7-a63422db111f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.245375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1268/2538] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:07.249255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259967-3abf-49e7-aa78-07202ba62230 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.259222 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259967-3abf-49e7-aa78-07202ba62230 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.264964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae500ff-214d-454e-8ff4-cd77eeb1716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.265653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae500ff-214d-454e-8ff4-cd77eeb1716c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.265917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae500ff-214d-454e-8ff4-cd77eeb1716c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.266340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae500ff-214d-454e-8ff4-cd77eeb1716c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.267086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae500ff-214d-454e-8ff4-cd77eeb1716c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.268698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae500ff-214d-454e-8ff4-cd77eeb1716c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.279527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1271/2539] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:07.284464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c4333-3144-42fd-bdd7-a63422db111f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.296841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c4333-3144-42fd-bdd7-a63422db111f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.302151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c595169-0632-4bfc-b198-db1c9bd30c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.302859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c595169-0632-4bfc-b198-db1c9bd30c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.303137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c595169-0632-4bfc-b198-db1c9bd30c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.303412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c595169-0632-4bfc-b198-db1c9bd30c86 admin admin] PATH_INFO: `/v3/projects/506ce43c6a65475097e109b376d4abe0/users/c9bfd956c4624a4a9716a40eeb13fe34/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.320934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c595169-0632-4bfc-b198-db1c9bd30c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506ce43c6a65475097e109b376d4abe0, user_id=c9bfd956c4624a4a9716a40eeb13fe34, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.323642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c595169-0632-4bfc-b198-db1c9bd30c86 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.326936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:07.343611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1269/2540] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:07 2022] PUT /identity/v3/projects/506ce43c6a65475097e109b376d4abe0/users/c9bfd956c4624a4a9716a40eeb13fe34/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:07.358013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde204d-bba3-4877-bc98-10f5d8fe4973 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.358206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde204d-bba3-4877-bc98-10f5d8fe4973 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.358487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde204d-bba3-4877-bc98-10f5d8fe4973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.388532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6cde204d-bba3-4877-bc98-10f5d8fe4973 None None] MFA Rules not processed for user `c9bfd956c4624a4a9716a40eeb13fe34`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:07.389821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6cde204d-bba3-4877-bc98-10f5d8fe4973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:07.462581 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1272/2541] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:07.467288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c595169-0632-4bfc-b198-db1c9bd30c86 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.545068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c595169-0632-4bfc-b198-db1c9bd30c86 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.550695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa2acb-ff0c-4cba-be76-fd0a65e9d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.551321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa2acb-ff0c-4cba-be76-fd0a65e9d393 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.551615 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa2acb-ff0c-4cba-be76-fd0a65e9d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.551871 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa2acb-ff0c-4cba-be76-fd0a65e9d393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.552563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa2acb-ff0c-4cba-be76-fd0a65e9d393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.554631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa2acb-ff0c-4cba-be76-fd0a65e9d393 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.586206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1270/2542] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:07 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:07.590255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde204d-bba3-4877-bc98-10f5d8fe4973 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.601206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde204d-bba3-4877-bc98-10f5d8fe4973 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.662056 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d00e5-bf8c-45aa-85d7-723c9e5b6806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.662690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d00e5-bf8c-45aa-85d7-723c9e5b6806 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.662965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d00e5-bf8c-45aa-85d7-723c9e5b6806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.663266 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d00e5-bf8c-45aa-85d7-723c9e5b6806 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.663942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d00e5-bf8c-45aa-85d7-723c9e5b6806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.665920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d00e5-bf8c-45aa-85d7-723c9e5b6806 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.682481 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:07.689818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1273/2543] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:07 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:07.694234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa2acb-ff0c-4cba-be76-fd0a65e9d393 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.709539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa2acb-ff0c-4cba-be76-fd0a65e9d393 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.718506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455efe67-1314-4394-966d-e490ee15f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.719772 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455efe67-1314-4394-966d-e490ee15f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.720054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455efe67-1314-4394-966d-e490ee15f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.720326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455efe67-1314-4394-966d-e490ee15f4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.721173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455efe67-1314-4394-966d-e490ee15f4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.722956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455efe67-1314-4394-966d-e490ee15f4c8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.735514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1271/2544] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:07.739676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d00e5-bf8c-45aa-85d7-723c9e5b6806 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.750381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d00e5-bf8c-45aa-85d7-723c9e5b6806 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.755865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1491bc-6011-4aa6-b01a-4c76f40bddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.756536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1491bc-6011-4aa6-b01a-4c76f40bddf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.756717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1491bc-6011-4aa6-b01a-4c76f40bddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.757049 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1491bc-6011-4aa6-b01a-4c76f40bddf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.757788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1491bc-6011-4aa6-b01a-4c76f40bddf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.759413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1491bc-6011-4aa6-b01a-4c76f40bddf2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.774011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1274/2545] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:34:07.778077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455efe67-1314-4394-966d-e490ee15f4c8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:07.789312 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455efe67-1314-4394-966d-e490ee15f4c8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:07.794018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338bc9a-fbd9-48db-a43d-73bb13ab62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:07.794763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338bc9a-fbd9-48db-a43d-73bb13ab62ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.795104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338bc9a-fbd9-48db-a43d-73bb13ab62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.795436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338bc9a-fbd9-48db-a43d-73bb13ab62ea admin admin] PATH_INFO: `/v3/projects/28de5e64fa964e8b819fba2a59a5a43e/users/e1e6d67a17eb4411863a675663de9582/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.811704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338bc9a-fbd9-48db-a43d-73bb13ab62ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=28de5e64fa964e8b819fba2a59a5a43e, user_id=e1e6d67a17eb4411863a675663de9582, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:07.814479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338bc9a-fbd9-48db-a43d-73bb13ab62ea admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:07.829797 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1272/2546] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:07 2022] PUT /identity/v3/projects/28de5e64fa964e8b819fba2a59a5a43e/users/e1e6d67a17eb4411863a675663de9582/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:07.842199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844dca4-6f4a-422c-b330-04b586bd193d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:07.842350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844dca4-6f4a-422c-b330-04b586bd193d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:07.842641 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844dca4-6f4a-422c-b330-04b586bd193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:07.874250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0844dca4-6f4a-422c-b330-04b586bd193d None None] MFA Rules not processed for user `e1e6d67a17eb4411863a675663de9582`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:07.875595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0844dca4-6f4a-422c-b330-04b586bd193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:07.947329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1275/2547] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:07.952535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338bc9a-fbd9-48db-a43d-73bb13ab62ea admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:08.034032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338bc9a-fbd9-48db-a43d-73bb13ab62ea admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:08.039738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454d24-4394-4c41-9a2b-aba09efec492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:08.040369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454d24-4394-4c41-9a2b-aba09efec492 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:08.040647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454d24-4394-4c41-9a2b-aba09efec492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:08.040922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454d24-4394-4c41-9a2b-aba09efec492 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:08.041635 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57454d24-4394-4c41-9a2b-aba09efec492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:08.043551 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57454d24-4394-4c41-9a2b-aba09efec492 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:08.074000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1273/2548] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:07 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:08.078578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844dca4-6f4a-422c-b330-04b586bd193d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:08.090399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844dca4-6f4a-422c-b330-04b586bd193d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:08.163854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ad49-608e-4b13-8fe9-9c0028d2257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:08.164504 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ad49-608e-4b13-8fe9-9c0028d2257b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:08.164785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ad49-608e-4b13-8fe9-9c0028d2257b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:08.165063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ad49-608e-4b13-8fe9-9c0028d2257b admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:08.165783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ad49-608e-4b13-8fe9-9c0028d2257b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:08.167809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ad49-608e-4b13-8fe9-9c0028d2257b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:08.192092 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1276/2549] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:08 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:08.196082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454d24-4394-4c41-9a2b-aba09efec492 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:08.207620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454d24-4394-4c41-9a2b-aba09efec492 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:08.212368 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c859ba4-500b-412a-a8ad-80a75eda138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:08.212942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c859ba4-500b-412a-a8ad-80a75eda138e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:08.213231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c859ba4-500b-412a-a8ad-80a75eda138e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:08.213532 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c859ba4-500b-412a-a8ad-80a75eda138e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:08.214236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c859ba4-500b-412a-a8ad-80a75eda138e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:08.216233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c859ba4-500b-412a-a8ad-80a75eda138e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:08.227028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1274/2550] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:34:08.231452 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ad49-608e-4b13-8fe9-9c0028d2257b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:08.241885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ad49-608e-4b13-8fe9-9c0028d2257b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:08.246759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acafb12-0438-41e0-b5dd-d3486b2ed6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:08.247397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acafb12-0438-41e0-b5dd-d3486b2ed6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:08.247679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acafb12-0438-41e0-b5dd-d3486b2ed6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:08.247954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acafb12-0438-41e0-b5dd-d3486b2ed6dd admin admin] PATH_INFO: `/v3/projects/21a93c080ebe48e38282f882772e5a15/users/d99f5e5883d149ffb6c65040190769ed/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:08.264978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acafb12-0438-41e0-b5dd-d3486b2ed6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a93c080ebe48e38282f882772e5a15, user_id=d99f5e5883d149ffb6c65040190769ed, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:08.267778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acafb12-0438-41e0-b5dd-d3486b2ed6dd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:08.283127 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1277/2551] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:08 2022] PUT /identity/v3/projects/21a93c080ebe48e38282f882772e5a15/users/d99f5e5883d149ffb6c65040190769ed/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:08.287458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c859ba4-500b-412a-a8ad-80a75eda138e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:08.297878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c859ba4-500b-412a-a8ad-80a75eda138e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:08.314885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:08.361137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034e026-8da6-4ee0-849d-f1688b7e8f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:08.362034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034e026-8da6-4ee0-849d-f1688b7e8f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:08.362330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034e026-8da6-4ee0-849d-f1688b7e8f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:08.362610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034e026-8da6-4ee0-849d-f1688b7e8f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:08.363589 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034e026-8da6-4ee0-849d-f1688b7e8f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:08.365790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034e026-8da6-4ee0-849d-f1688b7e8f28 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:08.377037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1275/2552] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:08.381757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acafb12-0438-41e0-b5dd-d3486b2ed6dd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:08.392830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acafb12-0438-41e0-b5dd-d3486b2ed6dd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:08.398052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3807cbd-22ea-4858-9e73-f9966e046417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:08.398737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3807cbd-22ea-4858-9e73-f9966e046417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:08.399012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3807cbd-22ea-4858-9e73-f9966e046417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:08.399323 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3807cbd-22ea-4858-9e73-f9966e046417 admin admin] PATH_INFO: `/v3/projects/21a93c080ebe48e38282f882772e5a15/users/d99f5e5883d149ffb6c65040190769ed/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:08.401681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3807cbd-22ea-4858-9e73-f9966e046417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a93c080ebe48e38282f882772e5a15, user_id=d99f5e5883d149ffb6c65040190769ed, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:08.404372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3807cbd-22ea-4858-9e73-f9966e046417 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:08.416543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1278/2553] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:08 2022] PUT /identity/v3/projects/21a93c080ebe48e38282f882772e5a15/users/d99f5e5883d149ffb6c65040190769ed/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:08.427679 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9562e88-3e41-4c48-9061-fc99db206012 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:08.427937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9562e88-3e41-4c48-9061-fc99db206012 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:08.428235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9562e88-3e41-4c48-9061-fc99db206012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:08.457067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a9562e88-3e41-4c48-9061-fc99db206012 None None] MFA Rules not processed for user `d99f5e5883d149ffb6c65040190769ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:08.458483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a9562e88-3e41-4c48-9061-fc99db206012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:08.530171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1276/2554] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:08.542671 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3807cbd-22ea-4858-9e73-f9966e046417 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:08.544559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d3807cbd-22ea-4858-9e73-f9966e046417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:08.578811 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:08.612653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3807cbd-22ea-4858-9e73-f9966e046417 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:08.616803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6a795-2a7f-45ef-8a99-79a221fba46d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:08.618020 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a795-2a7f-45ef-8a99-79a221fba46d service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:08.619750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a795-2a7f-45ef-8a99-79a221fba46d service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:08.620031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a795-2a7f-45ef-8a99-79a221fba46d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:08.630315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6a795-2a7f-45ef-8a99-79a221fba46d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:08.631776 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6a795-2a7f-45ef-8a99-79a221fba46d service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:08.642539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1279/2555] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:09.052135 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9562e88-3e41-4c48-9061-fc99db206012 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:09.062621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9562e88-3e41-4c48-9061-fc99db206012 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:09.066901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040630-ff94-4767-92c1-bb2a53e1107d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:09.067563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040630-ff94-4767-92c1-bb2a53e1107d service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:09.067838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040630-ff94-4767-92c1-bb2a53e1107d service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:09.068109 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040630-ff94-4767-92c1-bb2a53e1107d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:09.070609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f3040630-ff94-4767-92c1-bb2a53e1107d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:09.139366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3040630-ff94-4767-92c1-bb2a53e1107d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:09.140934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3040630-ff94-4767-92c1-bb2a53e1107d service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:09.153536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1277/2556] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:09.201885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6a795-2a7f-45ef-8a99-79a221fba46d service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:09.203329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-94f6a795-2a7f-45ef-8a99-79a221fba46d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:09.215435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6a795-2a7f-45ef-8a99-79a221fba46d service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:09.219201 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477404c-1307-44e8-938a-f4f53d42d01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:09.219825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477404c-1307-44e8-938a-f4f53d42d01c service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:09.220104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477404c-1307-44e8-938a-f4f53d42d01c service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:09.220378 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477404c-1307-44e8-938a-f4f53d42d01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:09.285619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477404c-1307-44e8-938a-f4f53d42d01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:09.287075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477404c-1307-44e8-938a-f4f53d42d01c service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:09.298107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1280/2557] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:34:13.460131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040630-ff94-4767-92c1-bb2a53e1107d service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:13.469492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040630-ff94-4767-92c1-bb2a53e1107d service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:13.474323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbea45-7d3d-478e-b9f0-8fdc4c7b512e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:13.474937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbea45-7d3d-478e-b9f0-8fdc4c7b512e service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:13.475211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbea45-7d3d-478e-b9f0-8fdc4c7b512e service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:13.475474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbea45-7d3d-478e-b9f0-8fdc4c7b512e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:13.512282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:13.545524 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbea45-7d3d-478e-b9f0-8fdc4c7b512e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:13.547004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbea45-7d3d-478e-b9f0-8fdc4c7b512e service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:13.556272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1278/2558] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:14.141257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477404c-1307-44e8-938a-f4f53d42d01c service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:14.143568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c477404c-1307-44e8-938a-f4f53d42d01c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:14.224331 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477404c-1307-44e8-938a-f4f53d42d01c service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:14.229309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:14.229966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:14.230248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:14.230526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] PATH_INFO: `/v3/users/69259c5bbef54d6cb352beb712b677b2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:14.231734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69259c5bbef54d6cb352beb712b677b2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:14.233738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:14.286538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69259c5bbef54d6cb352beb712b677b2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.287116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69259c5bbef54d6cb352beb712b677b2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.287718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69259c5bbef54d6cb352beb712b677b2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.301821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69259c5bbef54d6cb352beb712b677b2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.311492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69259c5bbef54d6cb352beb712b677b2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.312754 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:14.326837 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1281/2559] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:14 2022] DELETE /identity/v3/users/69259c5bbef54d6cb352beb712b677b2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:14.331472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db525d46-d981-4605-a65f-f504060fb242 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:14.331754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db525d46-d981-4605-a65f-f504060fb242 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:14.332025 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db525d46-d981-4605-a65f-f504060fb242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:14.351003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-db525d46-d981-4605-a65f-f504060fb242 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:14.352216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-db525d46-d981-4605-a65f-f504060fb242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:14.419882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1279/2560] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:14.431005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:14.432560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:14.499573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c6ff9-e9fa-4044-b4c5-6f7640ef32f0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:14.503885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332322fc-3356-42da-a5f0-4bfa2efe3a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:14.504583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332322fc-3356-42da-a5f0-4bfa2efe3a09 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:14.504933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332322fc-3356-42da-a5f0-4bfa2efe3a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:14.505287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332322fc-3356-42da-a5f0-4bfa2efe3a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:14.516343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332322fc-3356-42da-a5f0-4bfa2efe3a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:14.517863 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332322fc-3356-42da-a5f0-4bfa2efe3a09 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:14.528403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1282/2561] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:14.811356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db525d46-d981-4605-a65f-f504060fb242 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:14.813044 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-db525d46-d981-4605-a65f-f504060fb242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:14.829283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db525d46-d981-4605-a65f-f504060fb242 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:14.834884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:14.835727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:14.835851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:14.836071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] PATH_INFO: `/v3/projects/9e75694649a44f15a0bcf489fe265e10` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:14.837428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e75694649a44f15a0bcf489fe265e10)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:14.839441 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:14.900963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e75694649a44f15a0bcf489fe265e10', 'request_id': 'req-92418d64-154c-4003-b848-a014b4a6f926'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.911364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e75694649a44f15a0bcf489fe265e10', 'request_id': 'req-92418d64-154c-4003-b848-a014b4a6f926'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.917868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e75694649a44f15a0bcf489fe265e10', 'request_id': 'req-92418d64-154c-4003-b848-a014b4a6f926'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.930004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] The token cache is being invalidate because project 9e75694649a44f15a0bcf489fe265e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:14.930299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.930990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:14.932590 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1280/2562] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:14 2022] DELETE /identity/v3/projects/9e75694649a44f15a0bcf489fe265e10 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:14.936655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332322fc-3356-42da-a5f0-4bfa2efe3a09 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:14.946850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332322fc-3356-42da-a5f0-4bfa2efe3a09 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:15.011543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:15.012198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:15.012491 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:15.012762 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] PATH_INFO: `/v3/users/7e03876c86ff4cf2b1f8961baa5252ce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:15.013979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e03876c86ff4cf2b1f8961baa5252ce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:15.015945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:15.067178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e03876c86ff4cf2b1f8961baa5252ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.067948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e03876c86ff4cf2b1f8961baa5252ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.068732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e03876c86ff4cf2b1f8961baa5252ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.081287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e03876c86ff4cf2b1f8961baa5252ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.089938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5029f3dc-ef43-4436-a7d6-d9563b5aaee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e03876c86ff4cf2b1f8961baa5252ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.102531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1283/2563] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:14 2022] DELETE /identity/v3/users/7e03876c86ff4cf2b1f8961baa5252ce => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:15.383669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:15.385476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:15.412301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418d64-154c-4003-b848-a014b4a6f926 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:15.480355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:15.487782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:15.488537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:15.488821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:15.489130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] PATH_INFO: `/v3/projects/075d981abd7949f3b371e3952ecabf9f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:15.490535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=075d981abd7949f3b371e3952ecabf9f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:15.493356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:15.545609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075d981abd7949f3b371e3952ecabf9f', 'request_id': 'req-ed004b22-aca1-4167-a790-c44b001505f7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.553767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075d981abd7949f3b371e3952ecabf9f', 'request_id': 'req-ed004b22-aca1-4167-a790-c44b001505f7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.559729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075d981abd7949f3b371e3952ecabf9f', 'request_id': 'req-ed004b22-aca1-4167-a790-c44b001505f7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.573434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] The token cache is being invalidate because project 075d981abd7949f3b371e3952ecabf9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:15.573724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.574380 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed004b22-aca1-4167-a790-c44b001505f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.575978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1281/2564] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:15 2022] DELETE /identity/v3/projects/075d981abd7949f3b371e3952ecabf9f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:15.581796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc18d2-d6d3-49d3-9d25-da2fc395ffc8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:15.582552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc18d2-d6d3-49d3-9d25-da2fc395ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:15.582552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc18d2-d6d3-49d3-9d25-da2fc395ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:15.602041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-18fc18d2-d6d3-49d3-9d25-da2fc395ffc8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:15.603334 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-18fc18d2-d6d3-49d3-9d25-da2fc395ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:15.608812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:15.669037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1284/2565] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:15.744234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00d4c-14c3-4e40-843a-f105a81e908f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:15.744946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00d4c-14c3-4e40-843a-f105a81e908f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:15.744946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00d4c-14c3-4e40-843a-f105a81e908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:15.774369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c9b00d4c-14c3-4e40-843a-f105a81e908f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:15.775656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c9b00d4c-14c3-4e40-843a-f105a81e908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:15.784520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1282/2566] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:15.788887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc18d2-d6d3-49d3-9d25-da2fc395ffc8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:15.800887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc18d2-d6d3-49d3-9d25-da2fc395ffc8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:15.811823 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109830a8-b25f-4656-8a22-a9b95cba9c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:15.812131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b00d4c-14c3-4e40-843a-f105a81e908f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:15.812650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109830a8-b25f-4656-8a22-a9b95cba9c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:15.812934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109830a8-b25f-4656-8a22-a9b95cba9c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:15.813303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109830a8-b25f-4656-8a22-a9b95cba9c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:15.813691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c9b00d4c-14c3-4e40-843a-f105a81e908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:15.814058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109830a8-b25f-4656-8a22-a9b95cba9c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:34:15.814365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109830a8-b25f-4656-8a22-a9b95cba9c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:15.816532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109830a8-b25f-4656-8a22-a9b95cba9c57 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:15.827651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b00d4c-14c3-4e40-843a-f105a81e908f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:15.831810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1285/2567] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:34:15.833975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:15.834800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:15.835883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:15.835883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] PATH_INFO: `/v3/users/c9bfd956c4624a4a9716a40eeb13fe34` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:15.836953 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109830a8-b25f-4656-8a22-a9b95cba9c57 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:15.837068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bfd956c4624a4a9716a40eeb13fe34)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:15.839318 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:15.846928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109830a8-b25f-4656-8a22-a9b95cba9c57 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:15.851752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3d6e0-0028-4f70-9462-83d6399fbe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:15.852368 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3d6e0-0028-4f70-9462-83d6399fbe13 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:15.852653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3d6e0-0028-4f70-9462-83d6399fbe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:15.852928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3d6e0-0028-4f70-9462-83d6399fbe13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:15.853724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3d6e0-0028-4f70-9462-83d6399fbe13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:15.855682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3d6e0-0028-4f70-9462-83d6399fbe13 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:15.884905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1286/2568] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:15 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:15.888957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bfd956c4624a4a9716a40eeb13fe34'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.889369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3d6e0-0028-4f70-9462-83d6399fbe13 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:15.897874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bfd956c4624a4a9716a40eeb13fe34'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.910668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bfd956c4624a4a9716a40eeb13fe34'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.917744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bfd956c4624a4a9716a40eeb13fe34'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.918548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cd9980af-867a-404a-a4d5-2db118f9fe6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bfd956c4624a4a9716a40eeb13fe34'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:15.926711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1283/2569] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:15 2022] DELETE /identity/v3/users/c9bfd956c4624a4a9716a40eeb13fe34 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:15.931441 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844bce-1fb2-4c01-91de-1d0062255bd9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:15.931849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844bce-1fb2-4c01-91de-1d0062255bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:15.932221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844bce-1fb2-4c01-91de-1d0062255bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:15.953413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7c844bce-1fb2-4c01-91de-1d0062255bd9 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:15.954668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c844bce-1fb2-4c01-91de-1d0062255bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:15.959115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3d6e0-0028-4f70-9462-83d6399fbe13 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:16.006082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:16.018421 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b831-7b8a-4093-a70a-dd84cc6d46c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:16.019058 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b831-7b8a-4093-a70a-dd84cc6d46c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:16.019338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b831-7b8a-4093-a70a-dd84cc6d46c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:16.019611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b831-7b8a-4093-a70a-dd84cc6d46c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:16.020294 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9b831-7b8a-4093-a70a-dd84cc6d46c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:16.021377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1284/2570] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:16.022316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9b831-7b8a-4093-a70a-dd84cc6d46c8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:16.031358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844bce-1fb2-4c01-91de-1d0062255bd9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:16.032927 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c844bce-1fb2-4c01-91de-1d0062255bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:16.051211 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1287/2571] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:15 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:34:16.052393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b831-7b8a-4093-a70a-dd84cc6d46c8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:16.054483 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1ce9b831-7b8a-4093-a70a-dd84cc6d46c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:16.067055 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b831-7b8a-4093-a70a-dd84cc6d46c8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:16.072303 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91b504-cbb0-48f6-be7b-e050df0a618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:16.072928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91b504-cbb0-48f6-be7b-e050df0a618b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:16.073206 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91b504-cbb0-48f6-be7b-e050df0a618b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:16.073584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91b504-cbb0-48f6-be7b-e050df0a618b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:16.074288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91b504-cbb0-48f6-be7b-e050df0a618b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:16.075899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91b504-cbb0-48f6-be7b-e050df0a618b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:16.087870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1288/2572] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:16.094263 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91b504-cbb0-48f6-be7b-e050df0a618b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:16.099585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:16.105282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91b504-cbb0-48f6-be7b-e050df0a618b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:16.111927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee74d68-deb2-404e-8306-e5e69450f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:16.112306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844bce-1fb2-4c01-91de-1d0062255bd9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:16.112549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74d68-deb2-404e-8306-e5e69450f415 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:16.112828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74d68-deb2-404e-8306-e5e69450f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:16.113099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74d68-deb2-404e-8306-e5e69450f415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:16.113841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee74d68-deb2-404e-8306-e5e69450f415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:16.115472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee74d68-deb2-404e-8306-e5e69450f415 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:16.115937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dba82-125e-46df-b91f-36ed7f923482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:16.116567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dba82-125e-46df-b91f-36ed7f923482 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:16.116848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dba82-125e-46df-b91f-36ed7f923482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:16.117119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dba82-125e-46df-b91f-36ed7f923482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:16.126347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33dba82-125e-46df-b91f-36ed7f923482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:16.126626 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1289/2573] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:16.130632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee74d68-deb2-404e-8306-e5e69450f415 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:16.130757 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33dba82-125e-46df-b91f-36ed7f923482 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:16.140954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee74d68-deb2-404e-8306-e5e69450f415 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:16.141646 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1285/2574] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:34:16.147109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e977189-9125-4312-b815-131849b1529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:16.147888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977189-9125-4312-b815-131849b1529d admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:16.148177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977189-9125-4312-b815-131849b1529d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:16.148524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977189-9125-4312-b815-131849b1529d admin admin] PATH_INFO: `/v3/projects/9083c0481d8f40b3972f9dd3bbc08bda/users/38cdde55cb774d788171afb347659df5/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:16.165099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e977189-9125-4312-b815-131849b1529d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9083c0481d8f40b3972f9dd3bbc08bda, user_id=38cdde55cb774d788171afb347659df5, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:16.167906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e977189-9125-4312-b815-131849b1529d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:16.183227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1290/2575] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:16 2022] PUT /identity/v3/projects/9083c0481d8f40b3972f9dd3bbc08bda/users/38cdde55cb774d788171afb347659df5/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:16.195573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0743bc9-545e-4f0c-8c29-2367617232f5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:16.195944 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0743bc9-545e-4f0c-8c29-2367617232f5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:16.196325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0743bc9-545e-4f0c-8c29-2367617232f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:16.229051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b0743bc9-545e-4f0c-8c29-2367617232f5 None None] MFA Rules not processed for user `38cdde55cb774d788171afb347659df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:16.230332 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b0743bc9-545e-4f0c-8c29-2367617232f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:16.300922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1286/2576] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:16.312231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e977189-9125-4312-b815-131849b1529d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:16.314403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6e977189-9125-4312-b815-131849b1529d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:16.380231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e977189-9125-4312-b815-131849b1529d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:16.383887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9382227-cb20-40ba-a23e-f8a92faf6730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:16.384646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382227-cb20-40ba-a23e-f8a92faf6730 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:16.384926 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382227-cb20-40ba-a23e-f8a92faf6730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:16.385197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382227-cb20-40ba-a23e-f8a92faf6730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:16.393961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9382227-cb20-40ba-a23e-f8a92faf6730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:16.395399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9382227-cb20-40ba-a23e-f8a92faf6730 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:16.405029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1291/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:16.420064 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0743bc9-545e-4f0c-8c29-2367617232f5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:16.421625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b0743bc9-545e-4f0c-8c29-2367617232f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:16.494283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0743bc9-545e-4f0c-8c29-2367617232f5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:16.500359 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:16.501029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:16.501343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:16.501614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] PATH_INFO: `/v3/projects/506ce43c6a65475097e109b376d4abe0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:16.502817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=506ce43c6a65475097e109b376d4abe0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:16.504718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:16.540357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:16.558978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506ce43c6a65475097e109b376d4abe0', 'request_id': 'req-9b664712-b38a-41ac-8871-67cc1fc61fd7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.567328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506ce43c6a65475097e109b376d4abe0', 'request_id': 'req-9b664712-b38a-41ac-8871-67cc1fc61fd7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.579007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506ce43c6a65475097e109b376d4abe0', 'request_id': 'req-9b664712-b38a-41ac-8871-67cc1fc61fd7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.593973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] The token cache is being invalidate because project 506ce43c6a65475097e109b376d4abe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:16.594173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.594950 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.596944 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1287/2578] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:16 2022] DELETE /identity/v3/projects/506ce43c6a65475097e109b376d4abe0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:16.601195 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9382227-cb20-40ba-a23e-f8a92faf6730 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:16.613320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9382227-cb20-40ba-a23e-f8a92faf6730 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:16.683726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:16.684471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:16.684760 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:16.685035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] PATH_INFO: `/v3/users/e1e6d67a17eb4411863a675663de9582` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:16.686290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e6d67a17eb4411863a675663de9582)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:16.689095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:16.757680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e6d67a17eb4411863a675663de9582'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.758346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e6d67a17eb4411863a675663de9582'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.758954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e6d67a17eb4411863a675663de9582'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.776074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e6d67a17eb4411863a675663de9582'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.788759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e6d67a17eb4411863a675663de9582'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:16.790228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:16.805904 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1292/2579] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:16 2022] DELETE /identity/v3/users/e1e6d67a17eb4411863a675663de9582 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:17.113474 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:17.115048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:17.128567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b664712-b38a-41ac-8871-67cc1fc61fd7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:17.190225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:17.190920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:17.191203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:17.191480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] PATH_INFO: `/v3/projects/28de5e64fa964e8b819fba2a59a5a43e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:17.192781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28de5e64fa964e8b819fba2a59a5a43e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:17.194875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:17.245187 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28de5e64fa964e8b819fba2a59a5a43e', 'request_id': 'req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.254151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28de5e64fa964e8b819fba2a59a5a43e', 'request_id': 'req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.260438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28de5e64fa964e8b819fba2a59a5a43e', 'request_id': 'req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.272268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] The token cache is being invalidate because project 28de5e64fa964e8b819fba2a59a5a43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:17.272557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.273374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.274970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1288/2580] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:17 2022] DELETE /identity/v3/projects/28de5e64fa964e8b819fba2a59a5a43e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:17.280250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:17.282012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:17.296202 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8129-a921-4572-89f9-e895a04c4729 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:17.359029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:17.359678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:17.359950 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:17.360215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] PATH_INFO: `/v3/users/d99f5e5883d149ffb6c65040190769ed` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:17.361432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d99f5e5883d149ffb6c65040190769ed)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:17.363383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:17.414532 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd99f5e5883d149ffb6c65040190769ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.415255 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd99f5e5883d149ffb6c65040190769ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.415912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd99f5e5883d149ffb6c65040190769ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.428248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd99f5e5883d149ffb6c65040190769ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.437135 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-87069a1a-9e0a-4698-a55e-18b03f10db71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd99f5e5883d149ffb6c65040190769ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.450502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1293/2581] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:17 2022] DELETE /identity/v3/users/d99f5e5883d149ffb6c65040190769ed => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:17.742566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:17.744067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:17.757440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd6732-58e6-4eed-8e40-189ae2b4b7b3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:17.803152 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:17.820614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:17.821285 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:17.821687 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:17.821850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] PATH_INFO: `/v3/projects/21a93c080ebe48e38282f882772e5a15` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:17.823121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a93c080ebe48e38282f882772e5a15)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:17.825074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:17.874226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a93c080ebe48e38282f882772e5a15', 'request_id': 'req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.883440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a93c080ebe48e38282f882772e5a15', 'request_id': 'req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.890315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a93c080ebe48e38282f882772e5a15', 'request_id': 'req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.903151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] The token cache is being invalidate because project 21a93c080ebe48e38282f882772e5a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:17.903514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.904098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6e9f61-6330-4bfb-b66b-9c0f0183b267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:17.906180 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1289/2582] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:17 2022] DELETE /identity/v3/projects/21a93c080ebe48e38282f882772e5a15 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:17.912520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366f50-a7f4-43f1-9119-35ffbfed84c8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:17.913357 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366f50-a7f4-43f1-9119-35ffbfed84c8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:17.913597 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366f50-a7f4-43f1-9119-35ffbfed84c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:17.934619 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-01366f50-a7f4-43f1-9119-35ffbfed84c8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:17.935923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-01366f50-a7f4-43f1-9119-35ffbfed84c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:18.001100 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1294/2583] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:18.010055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dad54-3db9-4d77-bb7b-6dfa5acde5fa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:18.010438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dad54-3db9-4d77-bb7b-6dfa5acde5fa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:18.011179 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dad54-3db9-4d77-bb7b-6dfa5acde5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:18.033339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4b3dad54-3db9-4d77-bb7b-6dfa5acde5fa None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:18.034998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4b3dad54-3db9-4d77-bb7b-6dfa5acde5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:18.043786 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1290/2584] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:18.048226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01366f50-a7f4-43f1-9119-35ffbfed84c8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:18.058564 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01366f50-a7f4-43f1-9119-35ffbfed84c8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:18.063847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc3264-cf31-421a-8382-24da173f590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:18.064495 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc3264-cf31-421a-8382-24da173f590b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:18.064781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc3264-cf31-421a-8382-24da173f590b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:18.065191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc3264-cf31-421a-8382-24da173f590b admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:18.065943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc3264-cf31-421a-8382-24da173f590b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:34:18.066251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc3264-cf31-421a-8382-24da173f590b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:18.067899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc3264-cf31-421a-8382-24da173f590b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:18.070937 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:18.086026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1295/2585] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:34:18.087170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dad54-3db9-4d77-bb7b-6dfa5acde5fa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:18.097417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dad54-3db9-4d77-bb7b-6dfa5acde5fa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:18.102118 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f63b43-521f-479f-8b69-76c95e0d9b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:18.102777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f63b43-521f-479f-8b69-76c95e0d9b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:18.103082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f63b43-521f-479f-8b69-76c95e0d9b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:18.103396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f63b43-521f-479f-8b69-76c95e0d9b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:18.104082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f63b43-521f-479f-8b69-76c95e0d9b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:18.106019 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f63b43-521f-479f-8b69-76c95e0d9b7c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:18.135144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1291/2586] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:18 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:18.139375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc3264-cf31-421a-8382-24da173f590b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:18.150980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc3264-cf31-421a-8382-24da173f590b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:18.209131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964c4d9-221f-493b-86d4-cf7501cfb63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:18.209794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c4d9-221f-493b-86d4-cf7501cfb63e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:18.210078 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c4d9-221f-493b-86d4-cf7501cfb63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:18.210350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c4d9-221f-493b-86d4-cf7501cfb63e admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:18.211034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c4d9-221f-493b-86d4-cf7501cfb63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:18.213095 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c4d9-221f-493b-86d4-cf7501cfb63e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:18.243241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1296/2587] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:18 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:18.247473 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f63b43-521f-479f-8b69-76c95e0d9b7c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:18.258790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f63b43-521f-479f-8b69-76c95e0d9b7c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:18.263907 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00fb23-2395-4bfd-9621-dba05c6201fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:18.264568 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00fb23-2395-4bfd-9621-dba05c6201fa admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:18.264841 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00fb23-2395-4bfd-9621-dba05c6201fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:18.265146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00fb23-2395-4bfd-9621-dba05c6201fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:18.265911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00fb23-2395-4bfd-9621-dba05c6201fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:18.267773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00fb23-2395-4bfd-9621-dba05c6201fa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:18.279653 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1292/2588] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:34:18.283499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964c4d9-221f-493b-86d4-cf7501cfb63e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:18.294537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964c4d9-221f-493b-86d4-cf7501cfb63e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:18.300397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db198f48-77a1-4f87-8797-7da59a6e67d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:18.301030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198f48-77a1-4f87-8797-7da59a6e67d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:18.301340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198f48-77a1-4f87-8797-7da59a6e67d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:18.301615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198f48-77a1-4f87-8797-7da59a6e67d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:18.302329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db198f48-77a1-4f87-8797-7da59a6e67d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:18.303967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db198f48-77a1-4f87-8797-7da59a6e67d9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:18.326829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1297/2589] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:18.332897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00fb23-2395-4bfd-9621-dba05c6201fa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:18.343974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00fb23-2395-4bfd-9621-dba05c6201fa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:18.349616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fa13b-de80-4631-b94c-771e8ad13e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:18.350167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fa13b-de80-4631-b94c-771e8ad13e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:18.350446 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fa13b-de80-4631-b94c-771e8ad13e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:18.350728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fa13b-de80-4631-b94c-771e8ad13e70 admin admin] PATH_INFO: `/v3/projects/444f7fd4b9334dbc8b67b51f82413114/users/5e80a08077914999a9f23480166859b4/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:18.371127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fa13b-de80-4631-b94c-771e8ad13e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444f7fd4b9334dbc8b67b51f82413114, user_id=5e80a08077914999a9f23480166859b4, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:18.373895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fa13b-de80-4631-b94c-771e8ad13e70 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:18.390291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1293/2590] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:18 2022] PUT /identity/v3/projects/444f7fd4b9334dbc8b67b51f82413114/users/5e80a08077914999a9f23480166859b4/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:18.402850 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345680a-1a2a-44b2-802e-0389d8e51c86 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:18.403139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345680a-1a2a-44b2-802e-0389d8e51c86 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:18.403415 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345680a-1a2a-44b2-802e-0389d8e51c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:18.436436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5345680a-1a2a-44b2-802e-0389d8e51c86 None None] MFA Rules not processed for user `5e80a08077914999a9f23480166859b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:18.437752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5345680a-1a2a-44b2-802e-0389d8e51c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:18.515258 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1298/2591] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:18.523982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fa13b-de80-4631-b94c-771e8ad13e70 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:18.525693 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8d3fa13b-de80-4631-b94c-771e8ad13e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:18.587902 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fa13b-de80-4631-b94c-771e8ad13e70 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:18.591626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664202c-f2df-4bc0-b280-9c91755070de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecb8054ea4249d18903b5998fa753d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:18.592268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664202c-f2df-4bc0-b280-9c91755070de service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:18.592552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664202c-f2df-4bc0-b280-9c91755070de service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:18.592827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664202c-f2df-4bc0-b280-9c91755070de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:18.602101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664202c-f2df-4bc0-b280-9c91755070de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:18.603626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664202c-f2df-4bc0-b280-9c91755070de service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:18.613087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1294/2592] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:19.556200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345680a-1a2a-44b2-802e-0389d8e51c86 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:19.558072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5345680a-1a2a-44b2-802e-0389d8e51c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:19.631353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345680a-1a2a-44b2-802e-0389d8e51c86 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:19.636889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:19.638603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:19.638603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:19.638603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] PATH_INFO: `/v3/users/38cdde55cb774d788171afb347659df5` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:19.640251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38cdde55cb774d788171afb347659df5)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:19.641604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:19.647432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:19.702791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38cdde55cb774d788171afb347659df5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:19.703488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38cdde55cb774d788171afb347659df5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:19.704139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38cdde55cb774d788171afb347659df5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:19.717426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38cdde55cb774d788171afb347659df5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:19.726143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38cdde55cb774d788171afb347659df5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:19.743038 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1299/2593] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:19 2022] DELETE /identity/v3/users/38cdde55cb774d788171afb347659df5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:19.748156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555f6cf-9596-45b8-98aa-696c11dcd6a4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:19.748707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555f6cf-9596-45b8-98aa-696c11dcd6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:19.748707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555f6cf-9596-45b8-98aa-696c11dcd6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:19.771685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2555f6cf-9596-45b8-98aa-696c11dcd6a4 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:19.772931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2555f6cf-9596-45b8-98aa-696c11dcd6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:19.785849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:19.845818 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1295/2594] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:19.855704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:19.857381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:19.918738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198aa34-925e-4267-843e-26431d6272b4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:19.923209 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5d1c0-0d1f-4c84-8ee2-bfb2ba998270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:19.923839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d1c0-0d1f-4c84-8ee2-bfb2ba998270 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:19.924124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d1c0-0d1f-4c84-8ee2-bfb2ba998270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:19.924399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d1c0-0d1f-4c84-8ee2-bfb2ba998270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:19.935333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5d1c0-0d1f-4c84-8ee2-bfb2ba998270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:19.936785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5d1c0-0d1f-4c84-8ee2-bfb2ba998270 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:19.946880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1300/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:20.250325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555f6cf-9596-45b8-98aa-696c11dcd6a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:20.251942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2555f6cf-9596-45b8-98aa-696c11dcd6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:20.267274 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555f6cf-9596-45b8-98aa-696c11dcd6a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:20.273226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:20.273937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.274221 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.274529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] PATH_INFO: `/v3/projects/9083c0481d8f40b3972f9dd3bbc08bda` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.275998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9083c0481d8f40b3972f9dd3bbc08bda)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:20.278136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:20.337100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9083c0481d8f40b3972f9dd3bbc08bda', 'request_id': 'req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:20.345720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9083c0481d8f40b3972f9dd3bbc08bda', 'request_id': 'req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:20.351765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9083c0481d8f40b3972f9dd3bbc08bda', 'request_id': 'req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:20.363643 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] The token cache is being invalidate because project 9083c0481d8f40b3972f9dd3bbc08bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:20.363838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:20.364622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bc9c59-d2c9-4ecc-a948-d60708da3ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:20.366489 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1296/2596] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:20 2022] DELETE /identity/v3/projects/9083c0481d8f40b3972f9dd3bbc08bda => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:20.371993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee488d-1fc8-43e1-b556-08fdbd7aa627 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.372288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee488d-1fc8-43e1-b556-08fdbd7aa627 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.372566 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee488d-1fc8-43e1-b556-08fdbd7aa627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.393111 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4cee488d-1fc8-43e1-b556-08fdbd7aa627 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:20.394494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4cee488d-1fc8-43e1-b556-08fdbd7aa627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:20.463658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1301/2597] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:20.473073 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb76cb-8c08-40c4-b612-14fa68b7a0ce None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.473431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb76cb-8c08-40c4-b612-14fa68b7a0ce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.473701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb76cb-8c08-40c4-b612-14fa68b7a0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.499546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a0bb76cb-8c08-40c4-b612-14fa68b7a0ce None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:20.500777 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a0bb76cb-8c08-40c4-b612-14fa68b7a0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:20.510636 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1297/2598] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:20.515496 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee488d-1fc8-43e1-b556-08fdbd7aa627 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:20.526369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee488d-1fc8-43e1-b556-08fdbd7aa627 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:20.533389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa812e9e-2784-40ce-8bd0-533b2e094469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:20.534079 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa812e9e-2784-40ce-8bd0-533b2e094469 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.534343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa812e9e-2784-40ce-8bd0-533b2e094469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.534620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa812e9e-2784-40ce-8bd0-533b2e094469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.535459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa812e9e-2784-40ce-8bd0-533b2e094469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:34:20.535806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa812e9e-2784-40ce-8bd0-533b2e094469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:20.537851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa812e9e-2784-40ce-8bd0-533b2e094469 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:20.551636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1302/2599] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:34:20.556470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb76cb-8c08-40c4-b612-14fa68b7a0ce None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:20.567151 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb76cb-8c08-40c4-b612-14fa68b7a0ce None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:20.573339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b1ba1-81e0-4a78-892e-808cd1bc08ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:20.573986 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b1ba1-81e0-4a78-892e-808cd1bc08ad admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.574289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b1ba1-81e0-4a78-892e-808cd1bc08ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.574536 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b1ba1-81e0-4a78-892e-808cd1bc08ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.575209 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b1ba1-81e0-4a78-892e-808cd1bc08ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:20.577115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b1ba1-81e0-4a78-892e-808cd1bc08ad admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:20.610101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1298/2600] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:20 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:20.614472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa812e9e-2784-40ce-8bd0-533b2e094469 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:20.625200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa812e9e-2784-40ce-8bd0-533b2e094469 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:20.636559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:20.689374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1fd5-ea09-4f94-b372-aef928a6dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:20.690008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1fd5-ea09-4f94-b372-aef928a6dc9a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.690283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1fd5-ea09-4f94-b372-aef928a6dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.690553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1fd5-ea09-4f94-b372-aef928a6dc9a admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.691227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e1fd5-ea09-4f94-b372-aef928a6dc9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:20.693170 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e1fd5-ea09-4f94-b372-aef928a6dc9a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:20.724026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1303/2601] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:20 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:20.728837 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b1ba1-81e0-4a78-892e-808cd1bc08ad admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:20.744495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b1ba1-81e0-4a78-892e-808cd1bc08ad admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:20.752461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90e44-ade0-4054-a9ca-6c2a658360a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:20.753623 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90e44-ade0-4054-a9ca-6c2a658360a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.754105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90e44-ade0-4054-a9ca-6c2a658360a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.754628 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90e44-ade0-4054-a9ca-6c2a658360a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.755917 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a90e44-ade0-4054-a9ca-6c2a658360a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:20.758694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a90e44-ade0-4054-a9ca-6c2a658360a3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:20.777866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1299/2602] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:20.782624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1fd5-ea09-4f94-b372-aef928a6dc9a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:20.793900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1fd5-ea09-4f94-b372-aef928a6dc9a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:20.799880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986f6d0-26f6-4385-acb3-0b3507270e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:20.800553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986f6d0-26f6-4385-acb3-0b3507270e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.800833 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986f6d0-26f6-4385-acb3-0b3507270e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.801107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986f6d0-26f6-4385-acb3-0b3507270e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.801848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986f6d0-26f6-4385-acb3-0b3507270e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:20.803475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986f6d0-26f6-4385-acb3-0b3507270e96 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:20.817238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1304/2603] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:34:20.824252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90e44-ade0-4054-a9ca-6c2a658360a3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:20.836181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90e44-ade0-4054-a9ca-6c2a658360a3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:20.842678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde3ea4-9fb9-4e87-a5b9-ae6732dfeb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:20.843540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde3ea4-9fb9-4e87-a5b9-ae6732dfeb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.843889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde3ea4-9fb9-4e87-a5b9-ae6732dfeb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.844213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde3ea4-9fb9-4e87-a5b9-ae6732dfeb5d admin admin] PATH_INFO: `/v3/projects/b90bc89a74094bd4b69191391292fdc1/users/e72c20514e14423484a74405ba6eaeb9/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.863560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde3ea4-9fb9-4e87-a5b9-ae6732dfeb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90bc89a74094bd4b69191391292fdc1, user_id=e72c20514e14423484a74405ba6eaeb9, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:20.866402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde3ea4-9fb9-4e87-a5b9-ae6732dfeb5d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:20.883507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1300/2604] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:20 2022] PUT /identity/v3/projects/b90bc89a74094bd4b69191391292fdc1/users/e72c20514e14423484a74405ba6eaeb9/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:20.895479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757decd-c80b-4707-a7d4-049b6362b19e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:20.895763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757decd-c80b-4707-a7d4-049b6362b19e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:20.896036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757decd-c80b-4707-a7d4-049b6362b19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:20.927844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8757decd-c80b-4707-a7d4-049b6362b19e None None] MFA Rules not processed for user `e72c20514e14423484a74405ba6eaeb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:20.929216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8757decd-c80b-4707-a7d4-049b6362b19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:21.002254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1305/2605] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:21.014492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde3ea4-9fb9-4e87-a5b9-ae6732dfeb5d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:21.016339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0dde3ea4-9fb9-4e87-a5b9-ae6732dfeb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:21.065602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:21.093119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde3ea4-9fb9-4e87-a5b9-ae6732dfeb5d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:21.096940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6804ed-b676-41ea-b079-f9b7c2285fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:21.097621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6804ed-b676-41ea-b079-f9b7c2285fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:21.097897 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6804ed-b676-41ea-b079-f9b7c2285fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:21.098159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6804ed-b676-41ea-b079-f9b7c2285fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:21.107780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6804ed-b676-41ea-b079-f9b7c2285fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:21.109247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6804ed-b676-41ea-b079-f9b7c2285fd0 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:21.119627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1301/2606] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:22.533697 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34b75-e447-4df7-8f47-d8d7ac46beba None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:22.534272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34b75-e447-4df7-8f47-d8d7ac46beba None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:22.534272 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34b75-e447-4df7-8f47-d8d7ac46beba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:22.559288 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5eb34b75-e447-4df7-8f47-d8d7ac46beba None None] MFA Rules not processed for user `e72c20514e14423484a74405ba6eaeb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:22.560598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5eb34b75-e447-4df7-8f47-d8d7ac46beba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:22.568451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1306/2607] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:31.114782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=10 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:32.550172 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:34.291719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6804ed-b676-41ea-b079-f9b7c2285fd0 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:34.293457 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8a6804ed-b676-41ea-b079-f9b7c2285fd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:34.367397 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6804ed-b676-41ea-b079-f9b7c2285fd0 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:34.372835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:34.373535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:34.373912 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:34.374066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] PATH_INFO: `/v3/users/5e80a08077914999a9f23480166859b4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:34.375390 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e80a08077914999a9f23480166859b4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:34.377340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:34.441234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e80a08077914999a9f23480166859b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:34.450324 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e80a08077914999a9f23480166859b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:34.462998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e80a08077914999a9f23480166859b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:34.470271 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e80a08077914999a9f23480166859b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:34.471018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e80a08077914999a9f23480166859b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:34.477378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1302/2608] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:34 2022] DELETE /identity/v3/users/5e80a08077914999a9f23480166859b4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:34.481954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318c56-3009-45b9-8ade-749e95bc9862 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:34.482426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318c56-3009-45b9-8ade-749e95bc9862 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:34.482521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318c56-3009-45b9-8ade-749e95bc9862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:34.503061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d0318c56-3009-45b9-8ade-749e95bc9862 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:34.504297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d0318c56-3009-45b9-8ade-749e95bc9862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:34.568567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1307/2609] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:34.579029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:34.580664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:34.649629 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3741121-2ee1-4c1a-b83d-872bca068741 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:34.653654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97742f7e-0d6c-45cc-884d-eefce45ec1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:34.654298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742f7e-0d6c-45cc-884d-eefce45ec1fe service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:34.654578 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742f7e-0d6c-45cc-884d-eefce45ec1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:34.654850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742f7e-0d6c-45cc-884d-eefce45ec1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:34.671242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97742f7e-0d6c-45cc-884d-eefce45ec1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:34.672845 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97742f7e-0d6c-45cc-884d-eefce45ec1fe service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:34.683099 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1303/2610] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:34.971145 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318c56-3009-45b9-8ade-749e95bc9862 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:34.972633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d0318c56-3009-45b9-8ade-749e95bc9862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:34.985102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318c56-3009-45b9-8ade-749e95bc9862 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:34.991283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:34.992775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:34.992775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:34.992775 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] PATH_INFO: `/v3/projects/444f7fd4b9334dbc8b67b51f82413114` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:34.994603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] RBAC: Authorizing `identity:delete_project(project_id=444f7fd4b9334dbc8b67b51f82413114)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:34.996932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:35.048601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444f7fd4b9334dbc8b67b51f82413114', 'request_id': 'req-0feb8f8c-b424-4b2a-aecf-155bbb46812d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:35.056794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444f7fd4b9334dbc8b67b51f82413114', 'request_id': 'req-0feb8f8c-b424-4b2a-aecf-155bbb46812d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:35.062921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444f7fd4b9334dbc8b67b51f82413114', 'request_id': 'req-0feb8f8c-b424-4b2a-aecf-155bbb46812d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:35.077010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] The token cache is being invalidate because project 444f7fd4b9334dbc8b67b51f82413114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:35.077329 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:35.078018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0feb8f8c-b424-4b2a-aecf-155bbb46812d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:35.079958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1308/2611] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:34 2022] DELETE /identity/v3/projects/444f7fd4b9334dbc8b67b51f82413114 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:35.085168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebba2a-f3de-4f5c-a962-ec35cc8c624a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.085490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebba2a-f3de-4f5c-a962-ec35cc8c624a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.085765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebba2a-f3de-4f5c-a962-ec35cc8c624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.108458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ecebba2a-f3de-4f5c-a962-ec35cc8c624a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:35.109855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ecebba2a-f3de-4f5c-a962-ec35cc8c624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:35.127624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:35.175366 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1304/2612] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:35.183196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f04a-2d17-4257-bf96-95a33c59da17 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.183493 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f04a-2d17-4257-bf96-95a33c59da17 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.183777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f04a-2d17-4257-bf96-95a33c59da17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.204900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3d26f04a-2d17-4257-bf96-95a33c59da17 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:35.206176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3d26f04a-2d17-4257-bf96-95a33c59da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:35.215477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1309/2613] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:35.219982 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebba2a-f3de-4f5c-a962-ec35cc8c624a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:35.230114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebba2a-f3de-4f5c-a962-ec35cc8c624a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:35.234809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720c949-bf32-4fe7-8d66-9b2490c34fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:35.235465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720c949-bf32-4fe7-8d66-9b2490c34fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.235747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720c949-bf32-4fe7-8d66-9b2490c34fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.236022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720c949-bf32-4fe7-8d66-9b2490c34fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.236756 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720c949-bf32-4fe7-8d66-9b2490c34fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:34:35.237060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720c949-bf32-4fe7-8d66-9b2490c34fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:35.238705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720c949-bf32-4fe7-8d66-9b2490c34fa3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:35.251265 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1305/2614] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:34:35.257792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26f04a-2d17-4257-bf96-95a33c59da17 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:35.271423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26f04a-2d17-4257-bf96-95a33c59da17 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:35.279115 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809f0d-2531-43d9-8e71-b75e999383e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:35.280044 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809f0d-2531-43d9-8e71-b75e999383e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.280473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809f0d-2531-43d9-8e71-b75e999383e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.280862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809f0d-2531-43d9-8e71-b75e999383e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.281717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809f0d-2531-43d9-8e71-b75e999383e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:35.283692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809f0d-2531-43d9-8e71-b75e999383e0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:35.313625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1310/2615] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:35 2022] POST /identity/v3/projects => generated 359 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:35.317769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720c949-bf32-4fe7-8d66-9b2490c34fa3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:35.328546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720c949-bf32-4fe7-8d66-9b2490c34fa3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:35.397094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702aaea-1034-4477-aaf9-db2cc9a0a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:35.397764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702aaea-1034-4477-aaf9-db2cc9a0a035 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.398060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702aaea-1034-4477-aaf9-db2cc9a0a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.398334 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702aaea-1034-4477-aaf9-db2cc9a0a035 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.399032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702aaea-1034-4477-aaf9-db2cc9a0a035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:35.400949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702aaea-1034-4477-aaf9-db2cc9a0a035 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:35.430065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1306/2616] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:35 2022] POST /identity/v3/users => generated 280 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:35.431578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809f0d-2531-43d9-8e71-b75e999383e0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:35.443191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809f0d-2531-43d9-8e71-b75e999383e0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:35.449500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3aa9c-de31-4390-8dee-be734354375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:35.450594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3aa9c-de31-4390-8dee-be734354375b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.450594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3aa9c-de31-4390-8dee-be734354375b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.451050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3aa9c-de31-4390-8dee-be734354375b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.451985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3aa9c-de31-4390-8dee-be734354375b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:35.453752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3aa9c-de31-4390-8dee-be734354375b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:35.465553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1311/2617] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:35.469563 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702aaea-1034-4477-aaf9-db2cc9a0a035 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:35.480213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702aaea-1034-4477-aaf9-db2cc9a0a035 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:35.485340 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a67213-06b4-4a1c-a677-8cc941c82a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:35.485998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67213-06b4-4a1c-a677-8cc941c82a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.486423 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67213-06b4-4a1c-a677-8cc941c82a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.486698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67213-06b4-4a1c-a677-8cc941c82a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.487416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a67213-06b4-4a1c-a677-8cc941c82a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:35.489036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a67213-06b4-4a1c-a677-8cc941c82a6f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:35.501148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1307/2618] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:35.505550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3aa9c-de31-4390-8dee-be734354375b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:35.518435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3aa9c-de31-4390-8dee-be734354375b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:35.524394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61997b3d-a29e-496d-850f-e220375eb8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:35.525403 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61997b3d-a29e-496d-850f-e220375eb8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.525695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61997b3d-a29e-496d-850f-e220375eb8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.525985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61997b3d-a29e-496d-850f-e220375eb8c4 admin admin] PATH_INFO: `/v3/projects/cb062de0e9a2417b985baa8825dff6e5/users/b00f94b963a74643873673d79587d7c7/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.543175 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61997b3d-a29e-496d-850f-e220375eb8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb062de0e9a2417b985baa8825dff6e5, user_id=b00f94b963a74643873673d79587d7c7, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:35.546022 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61997b3d-a29e-496d-850f-e220375eb8c4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:35.561353 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1312/2619] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:35 2022] PUT /identity/v3/projects/cb062de0e9a2417b985baa8825dff6e5/users/b00f94b963a74643873673d79587d7c7/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:35.573292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30622e6-90a5-476c-bf60-0d7aa4c92fe7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.573626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30622e6-90a5-476c-bf60-0d7aa4c92fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.574012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30622e6-90a5-476c-bf60-0d7aa4c92fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.605335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b30622e6-90a5-476c-bf60-0d7aa4c92fe7 None None] MFA Rules not processed for user `b00f94b963a74643873673d79587d7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:35.606555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b30622e6-90a5-476c-bf60-0d7aa4c92fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:35.684807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1308/2620] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:35.724197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61997b3d-a29e-496d-850f-e220375eb8c4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:35.726152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-61997b3d-a29e-496d-850f-e220375eb8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:35.750859 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:35.801360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61997b3d-a29e-496d-850f-e220375eb8c4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:35.805990 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333e5c-099d-4ad9-9778-e48ea9133c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:35.806652 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333e5c-099d-4ad9-9778-e48ea9133c17 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.806936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333e5c-099d-4ad9-9778-e48ea9133c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.807192 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333e5c-099d-4ad9-9778-e48ea9133c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.816495 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333e5c-099d-4ad9-9778-e48ea9133c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:35.818075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333e5c-099d-4ad9-9778-e48ea9133c17 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:35.827854 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1313/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:35 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:35.848114 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30622e6-90a5-476c-bf60-0d7aa4c92fe7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:35.869358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:35.917650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30622e6-90a5-476c-bf60-0d7aa4c92fe7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:35.922942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:35.923601 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:35.923875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:35.924141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] PATH_INFO: `/v3/users/b00f94b963a74643873673d79587d7c7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:35.925369 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00f94b963a74643873673d79587d7c7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:35.927336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:35.978057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00f94b963a74643873673d79587d7c7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:35.987082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00f94b963a74643873673d79587d7c7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:36.003512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00f94b963a74643873673d79587d7c7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:36.011835 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00f94b963a74643873673d79587d7c7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:36.012671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00f94b963a74643873673d79587d7c7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:36.019226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1309/2622] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:35 2022] DELETE /identity/v3/users/b00f94b963a74643873673d79587d7c7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:36.024013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f33e23-717e-482b-a117-74f805ad725b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:36.024381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f33e23-717e-482b-a117-74f805ad725b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:36.024662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f33e23-717e-482b-a117-74f805ad725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:36.046996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-18f33e23-717e-482b-a117-74f805ad725b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:36.048369 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-18f33e23-717e-482b-a117-74f805ad725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:36.116908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1314/2623] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:36.127198 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:36.128727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:36.191752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eca09-e96e-41a9-8b15-02971ff390ba admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:36.195905 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a5414-6dcb-4bf9-af5c-e8b16fed5aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:36.196549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a5414-6dcb-4bf9-af5c-e8b16fed5aee service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:36.196826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a5414-6dcb-4bf9-af5c-e8b16fed5aee service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:36.197098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a5414-6dcb-4bf9-af5c-e8b16fed5aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:36.206947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a5414-6dcb-4bf9-af5c-e8b16fed5aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:36.208426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a5414-6dcb-4bf9-af5c-e8b16fed5aee service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:36.218631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1310/2624] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:36.942417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f33e23-717e-482b-a117-74f805ad725b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:36.944047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-18f33e23-717e-482b-a117-74f805ad725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:36.958075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f33e23-717e-482b-a117-74f805ad725b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:36.964101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:36.964923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:36.965449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:36.966099 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] PATH_INFO: `/v3/projects/cb062de0e9a2417b985baa8825dff6e5` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:36.971784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb062de0e9a2417b985baa8825dff6e5)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:36.977478 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:37.118567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb062de0e9a2417b985baa8825dff6e5', 'request_id': 'req-f6bed569-4e57-44d7-b908-730c0b6e101d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:37.129360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb062de0e9a2417b985baa8825dff6e5', 'request_id': 'req-f6bed569-4e57-44d7-b908-730c0b6e101d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:37.140740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb062de0e9a2417b985baa8825dff6e5', 'request_id': 'req-f6bed569-4e57-44d7-b908-730c0b6e101d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:37.164585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] The token cache is being invalidate because project cb062de0e9a2417b985baa8825dff6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:37.165151 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:37.166517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f6bed569-4e57-44d7-b908-730c0b6e101d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:37.169040 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1315/2625] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:36 2022] DELETE /identity/v3/projects/cb062de0e9a2417b985baa8825dff6e5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:37.175023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74767d78-733a-4317-af0e-da53e4cc9223 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:37.175543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74767d78-733a-4317-af0e-da53e4cc9223 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:37.175543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74767d78-733a-4317-af0e-da53e4cc9223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:37.202564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-74767d78-733a-4317-af0e-da53e4cc9223 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:37.204091 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-74767d78-733a-4317-af0e-da53e4cc9223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:37.250107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:37.280226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1311/2626] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:37.288194 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3e909-e60b-4411-ac3b-69ade74cecca None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:37.288588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3e909-e60b-4411-ac3b-69ade74cecca None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:37.288871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3e909-e60b-4411-ac3b-69ade74cecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:37.311797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dac3e909-e60b-4411-ac3b-69ade74cecca None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:37.313312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dac3e909-e60b-4411-ac3b-69ade74cecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:37.322851 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1316/2627] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:37.327308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74767d78-733a-4317-af0e-da53e4cc9223 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:37.337746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74767d78-733a-4317-af0e-da53e4cc9223 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:37.343963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d28216-bf1c-4124-b167-c01647444512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:37.344667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d28216-bf1c-4124-b167-c01647444512 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:37.345548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d28216-bf1c-4124-b167-c01647444512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:37.345884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d28216-bf1c-4124-b167-c01647444512 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:37.346666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d28216-bf1c-4124-b167-c01647444512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:34:37.346975 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d28216-bf1c-4124-b167-c01647444512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:37.348666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d28216-bf1c-4124-b167-c01647444512 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:37.364781 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1312/2628] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:34:37.369575 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3e909-e60b-4411-ac3b-69ade74cecca None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:37.380436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3e909-e60b-4411-ac3b-69ade74cecca None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:37.390723 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3c1b0-b289-4095-9ac4-2d88f208cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:37.391393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3c1b0-b289-4095-9ac4-2d88f208cd82 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:37.391674 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3c1b0-b289-4095-9ac4-2d88f208cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:37.391945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3c1b0-b289-4095-9ac4-2d88f208cd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:37.392708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3c1b0-b289-4095-9ac4-2d88f208cd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:37.394753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3c1b0-b289-4095-9ac4-2d88f208cd82 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:37.444508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1317/2629] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:37 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:37.446286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d28216-bf1c-4124-b167-c01647444512 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:37.464686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d28216-bf1c-4124-b167-c01647444512 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:37.543553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9397-211b-48d6-b64a-53dbaa83ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:37.544162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9397-211b-48d6-b64a-53dbaa83ab4d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:37.544506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9397-211b-48d6-b64a-53dbaa83ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:37.544819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9397-211b-48d6-b64a-53dbaa83ab4d admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:37.546749 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c9397-211b-48d6-b64a-53dbaa83ab4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:37.548651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c9397-211b-48d6-b64a-53dbaa83ab4d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:37.573292 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1313/2630] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:37 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:37.577782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3c1b0-b289-4095-9ac4-2d88f208cd82 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:37.593094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3c1b0-b289-4095-9ac4-2d88f208cd82 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:37.598107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ded7f-7a99-469f-b467-6a809fd3f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:37.598687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ded7f-7a99-469f-b467-6a809fd3f51f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:37.599350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ded7f-7a99-469f-b467-6a809fd3f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:37.599350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ded7f-7a99-469f-b467-6a809fd3f51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:37.599993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ded7f-7a99-469f-b467-6a809fd3f51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:37.601672 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ded7f-7a99-469f-b467-6a809fd3f51f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:37.613238 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1318/2631] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:37.617068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9397-211b-48d6-b64a-53dbaa83ab4d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:37.634822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9397-211b-48d6-b64a-53dbaa83ab4d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:37.641889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519da35-c160-490f-8e71-e4afbf88ee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:37.642570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519da35-c160-490f-8e71-e4afbf88ee8e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:37.643126 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519da35-c160-490f-8e71-e4afbf88ee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:37.643242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519da35-c160-490f-8e71-e4afbf88ee8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:37.659580 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519da35-c160-490f-8e71-e4afbf88ee8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:37.662293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519da35-c160-490f-8e71-e4afbf88ee8e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:37.678428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1314/2632] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:37.682724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ded7f-7a99-469f-b467-6a809fd3f51f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:37.698853 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ded7f-7a99-469f-b467-6a809fd3f51f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:37.704959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc5c5-31fd-4db4-8ead-9ad39cf2a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:37.706696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc5c5-31fd-4db4-8ead-9ad39cf2a493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:37.707396 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc5c5-31fd-4db4-8ead-9ad39cf2a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:37.707534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc5c5-31fd-4db4-8ead-9ad39cf2a493 admin admin] PATH_INFO: `/v3/projects/aed00274eed6462ab8add929ba8c1f5c/users/d4ebd20bb18d4073b3d75561bd68b552/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:37.711537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:37.729297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbc5c5-31fd-4db4-8ead-9ad39cf2a493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed00274eed6462ab8add929ba8c1f5c, user_id=d4ebd20bb18d4073b3d75561bd68b552, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:37.735223 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbc5c5-31fd-4db4-8ead-9ad39cf2a493 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:37.758799 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1319/2633] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:37 2022] PUT /identity/v3/projects/aed00274eed6462ab8add929ba8c1f5c/users/d4ebd20bb18d4073b3d75561bd68b552/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:37.770408 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50b77-741b-4337-a105-cadfa5b57886 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:37.771787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50b77-741b-4337-a105-cadfa5b57886 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:37.772078 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50b77-741b-4337-a105-cadfa5b57886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:37.815122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bba50b77-741b-4337-a105-cadfa5b57886 None None] MFA Rules not processed for user `d4ebd20bb18d4073b3d75561bd68b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:37.818500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bba50b77-741b-4337-a105-cadfa5b57886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:37.920068 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1315/2634] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:37.924727 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc5c5-31fd-4db4-8ead-9ad39cf2a493 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.060253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc5c5-31fd-4db4-8ead-9ad39cf2a493 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.070738 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ce2e-4c91-4be1-961b-3420f1097be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.073143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ce2e-4c91-4be1-961b-3420f1097be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.073533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ce2e-4c91-4be1-961b-3420f1097be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.073947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ce2e-4c91-4be1-961b-3420f1097be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.075875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ce2e-4c91-4be1-961b-3420f1097be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.079510 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ce2e-4c91-4be1-961b-3420f1097be9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.110735 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1320/2635] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:37 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:34:38.114861 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50b77-741b-4337-a105-cadfa5b57886 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.128621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50b77-741b-4337-a105-cadfa5b57886 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.164123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:38.198081 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be146e6e-3e62-4046-85af-7d679e190dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.199259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be146e6e-3e62-4046-85af-7d679e190dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.199259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be146e6e-3e62-4046-85af-7d679e190dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.199259 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be146e6e-3e62-4046-85af-7d679e190dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.200160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be146e6e-3e62-4046-85af-7d679e190dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.202139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be146e6e-3e62-4046-85af-7d679e190dfb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.225218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1316/2636] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:38 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:38.229155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ce2e-4c91-4be1-961b-3420f1097be9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.239914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ce2e-4c91-4be1-961b-3420f1097be9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.244755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a05d6-3e02-4ec2-b974-dfdc6f631c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.245418 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a05d6-3e02-4ec2-b974-dfdc6f631c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.245703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a05d6-3e02-4ec2-b974-dfdc6f631c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.245974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a05d6-3e02-4ec2-b974-dfdc6f631c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.246820 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a05d6-3e02-4ec2-b974-dfdc6f631c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.248314 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a05d6-3e02-4ec2-b974-dfdc6f631c8d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.259751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1321/2637] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:38.264161 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be146e6e-3e62-4046-85af-7d679e190dfb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.277010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be146e6e-3e62-4046-85af-7d679e190dfb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.282627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0255-87bb-4f6d-8e3c-096b624e933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.283265 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0255-87bb-4f6d-8e3c-096b624e933a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.283596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0255-87bb-4f6d-8e3c-096b624e933a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.283873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0255-87bb-4f6d-8e3c-096b624e933a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.284588 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0255-87bb-4f6d-8e3c-096b624e933a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.286250 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0255-87bb-4f6d-8e3c-096b624e933a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.297240 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1317/2638] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:38.301514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a05d6-3e02-4ec2-b974-dfdc6f631c8d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.311839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a05d6-3e02-4ec2-b974-dfdc6f631c8d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.316891 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fb36b-d3a4-4108-b328-62ebea557c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.317598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb36b-d3a4-4108-b328-62ebea557c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.317885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb36b-d3a4-4108-b328-62ebea557c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.318182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb36b-d3a4-4108-b328-62ebea557c75 admin admin] PATH_INFO: `/v3/projects/e2daf1bf4e7344d886a275ccc7134ef1/users/93048114c47b40fda453851407378d2d/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.333954 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fb36b-d3a4-4108-b328-62ebea557c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2daf1bf4e7344d886a275ccc7134ef1, user_id=93048114c47b40fda453851407378d2d, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.336640 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fb36b-d3a4-4108-b328-62ebea557c75 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.351777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1322/2639] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:38 2022] PUT /identity/v3/projects/e2daf1bf4e7344d886a275ccc7134ef1/users/93048114c47b40fda453851407378d2d/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:38.363373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b2e9f-6a61-4d2a-89f0-4327daa65766 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.363667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b2e9f-6a61-4d2a-89f0-4327daa65766 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.363942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b2e9f-6a61-4d2a-89f0-4327daa65766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.391719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-507b2e9f-6a61-4d2a-89f0-4327daa65766 None None] MFA Rules not processed for user `93048114c47b40fda453851407378d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:38.392973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-507b2e9f-6a61-4d2a-89f0-4327daa65766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:38.461774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1318/2640] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:38.466340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fb36b-d3a4-4108-b328-62ebea557c75 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.537030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fb36b-d3a4-4108-b328-62ebea557c75 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.542168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a0d3-5161-472a-9f63-1ec392ef5b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.542810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a0d3-5161-472a-9f63-1ec392ef5b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.543096 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a0d3-5161-472a-9f63-1ec392ef5b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.543371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a0d3-5161-472a-9f63-1ec392ef5b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.544065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9a0d3-5161-472a-9f63-1ec392ef5b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.546028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9a0d3-5161-472a-9f63-1ec392ef5b1f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.575173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1323/2641] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:38 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:34:38.579554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b2e9f-6a61-4d2a-89f0-4327daa65766 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.591236 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b2e9f-6a61-4d2a-89f0-4327daa65766 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.656464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3d5c5-9981-446a-bade-74c7872fabc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.657360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3d5c5-9981-446a-bade-74c7872fabc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.657712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3d5c5-9981-446a-bade-74c7872fabc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.658051 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3d5c5-9981-446a-bade-74c7872fabc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.658808 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3d5c5-9981-446a-bade-74c7872fabc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.661020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3d5c5-9981-446a-bade-74c7872fabc6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.690642 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1319/2642] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:38 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:34:38.698508 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a0d3-5161-472a-9f63-1ec392ef5b1f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.709646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a0d3-5161-472a-9f63-1ec392ef5b1f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.715681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45304d0-88cf-4de4-80e5-14c6e39b3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.716312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45304d0-88cf-4de4-80e5-14c6e39b3435 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.716596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45304d0-88cf-4de4-80e5-14c6e39b3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.716857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45304d0-88cf-4de4-80e5-14c6e39b3435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.717664 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45304d0-88cf-4de4-80e5-14c6e39b3435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.719366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45304d0-88cf-4de4-80e5-14c6e39b3435 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.733521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1324/2643] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:38.736889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3d5c5-9981-446a-bade-74c7872fabc6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.747302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3d5c5-9981-446a-bade-74c7872fabc6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.757531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569de5e5-c216-47cd-be44-35ae44f47514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.757531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569de5e5-c216-47cd-be44-35ae44f47514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.757531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569de5e5-c216-47cd-be44-35ae44f47514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.757531 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569de5e5-c216-47cd-be44-35ae44f47514 admin admin] PATH_INFO: `/v3/projects/fa543d83ac1040c5a1da2a1861b343de/users/dd6d095e1ae749ffad8cfb9d0ea07e08/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.774955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569de5e5-c216-47cd-be44-35ae44f47514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa543d83ac1040c5a1da2a1861b343de, user_id=dd6d095e1ae749ffad8cfb9d0ea07e08, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.778942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569de5e5-c216-47cd-be44-35ae44f47514 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.793420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1320/2644] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:38 2022] PUT /identity/v3/projects/fa543d83ac1040c5a1da2a1861b343de/users/dd6d095e1ae749ffad8cfb9d0ea07e08/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:38.797595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45304d0-88cf-4de4-80e5-14c6e39b3435 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.809767 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45304d0-88cf-4de4-80e5-14c6e39b3435 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.814761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:38.827487 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211a8e1-f229-46e9-af73-ce0324bc2b0b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.827968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211a8e1-f229-46e9-af73-ce0324bc2b0b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.828320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211a8e1-f229-46e9-af73-ce0324bc2b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.854159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b211a8e1-f229-46e9-af73-ce0324bc2b0b None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:38.856764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b211a8e1-f229-46e9-af73-ce0324bc2b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:38.865508 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:38.900828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4836a8-8313-4ad8-a7a2-4a557dfa87df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.901771 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4836a8-8313-4ad8-a7a2-4a557dfa87df admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.902239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4836a8-8313-4ad8-a7a2-4a557dfa87df admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.902734 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4836a8-8313-4ad8-a7a2-4a557dfa87df admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.903463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4836a8-8313-4ad8-a7a2-4a557dfa87df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.905132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4836a8-8313-4ad8-a7a2-4a557dfa87df admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.919991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1325/2645] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:34:38.924413 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4836a8-8313-4ad8-a7a2-4a557dfa87df admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.935199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4836a8-8313-4ad8-a7a2-4a557dfa87df admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:38.940599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b643be-8ff2-4ed0-a3a1-4a10f2e10f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:38.941345 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b643be-8ff2-4ed0-a3a1-4a10f2e10f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.941633 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b643be-8ff2-4ed0-a3a1-4a10f2e10f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.941908 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b643be-8ff2-4ed0-a3a1-4a10f2e10f51 admin admin] PATH_INFO: `/v3/projects/fa543d83ac1040c5a1da2a1861b343de/users/dd6d095e1ae749ffad8cfb9d0ea07e08/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.943921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b643be-8ff2-4ed0-a3a1-4a10f2e10f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa543d83ac1040c5a1da2a1861b343de, user_id=dd6d095e1ae749ffad8cfb9d0ea07e08, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:38.946987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b643be-8ff2-4ed0-a3a1-4a10f2e10f51 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:38.947462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1321/2646] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:34:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:38.958339 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1326/2647] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:38 2022] PUT /identity/v3/projects/fa543d83ac1040c5a1da2a1861b343de/users/dd6d095e1ae749ffad8cfb9d0ea07e08/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:38.969449 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efd6d3-0cd8-441e-a845-fd0e2b98a91a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:38.969740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efd6d3-0cd8-441e-a845-fd0e2b98a91a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:38.970314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efd6d3-0cd8-441e-a845-fd0e2b98a91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:38.971505 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b643be-8ff2-4ed0-a3a1-4a10f2e10f51 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:38.973301 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-86b643be-8ff2-4ed0-a3a1-4a10f2e10f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:39.001813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b0efd6d3-0cd8-441e-a845-fd0e2b98a91a None None] MFA Rules not processed for user `dd6d095e1ae749ffad8cfb9d0ea07e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:39.002946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b0efd6d3-0cd8-441e-a845-fd0e2b98a91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:39.055177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b643be-8ff2-4ed0-a3a1-4a10f2e10f51 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:39.062587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e8534-da9a-4510-873e-d50bc1940531 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:39.063624 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e8534-da9a-4510-873e-d50bc1940531 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:39.063996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e8534-da9a-4510-873e-d50bc1940531 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:39.064612 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e8534-da9a-4510-873e-d50bc1940531 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:39.091725 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1322/2648] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:39.104464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efd6d3-0cd8-441e-a845-fd0e2b98a91a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:39.106211 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b0efd6d3-0cd8-441e-a845-fd0e2b98a91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:39.135015 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e8534-da9a-4510-873e-d50bc1940531 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:39.137191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e8534-da9a-4510-873e-d50bc1940531 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:39.146843 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1327/2649] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:34:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 07:34:39.177502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efd6d3-0cd8-441e-a845-fd0e2b98a91a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:39.181375 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d0f92-7e4a-42e9-b111-bb3767b133cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:39.182067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d0f92-7e4a-42e9-b111-bb3767b133cb service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:39.182349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d0f92-7e4a-42e9-b111-bb3767b133cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:39.182613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d0f92-7e4a-42e9-b111-bb3767b133cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:39.271401 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d0f92-7e4a-42e9-b111-bb3767b133cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:39.273437 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:39.274271 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d0f92-7e4a-42e9-b111-bb3767b133cb service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:39.287254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1323/2650] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:34:39.817485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf0703-aa66-4afd-ac62-ed32dd7b37f8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:39.817807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf0703-aa66-4afd-ac62-ed32dd7b37f8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:39.818862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf0703-aa66-4afd-ac62-ed32dd7b37f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:39.839291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2ccf0703-aa66-4afd-ac62-ed32dd7b37f8 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:39.840518 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2ccf0703-aa66-4afd-ac62-ed32dd7b37f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:39.848879 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1328/2651] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 26 07:34:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:39.864134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d0f92-7e4a-42e9-b111-bb3767b133cb service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:39.880009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d0f92-7e4a-42e9-b111-bb3767b133cb service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:39.886789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fda68e-6941-40f1-be1b-1ec927c86b6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:39.887434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fda68e-6941-40f1-be1b-1ec927c86b6c service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:39.887813 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fda68e-6941-40f1-be1b-1ec927c86b6c service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:39.887977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fda68e-6941-40f1-be1b-1ec927c86b6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:39.898608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fda68e-6941-40f1-be1b-1ec927c86b6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:39.900128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fda68e-6941-40f1-be1b-1ec927c86b6c service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:39.910309 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1324/2652] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:34:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:34:40.135903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ccf2-3b33-45d5-b864-9c9c65f80914 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:40.136436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ccf2-3b33-45d5-b864-9c9c65f80914 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:40.136436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ccf2-3b33-45d5-b864-9c9c65f80914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:40.163292 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b1e6ccf2-3b33-45d5-b864-9c9c65f80914 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:40.164682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b1e6ccf2-3b33-45d5-b864-9c9c65f80914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:40.173655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1329/2653] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 26 07:34:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:40.188288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fda68e-6941-40f1-be1b-1ec927c86b6c service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:40.199880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fda68e-6941-40f1-be1b-1ec927c86b6c service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:40.206110 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b0cd7-2cd3-4bdb-8839-2e8b5fd9e9d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:40.206747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b0cd7-2cd3-4bdb-8839-2e8b5fd9e9d9 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:40.207021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b0cd7-2cd3-4bdb-8839-2e8b5fd9e9d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:40.207300 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b0cd7-2cd3-4bdb-8839-2e8b5fd9e9d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:40.216074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b0cd7-2cd3-4bdb-8839-2e8b5fd9e9d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:40.217724 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b0cd7-2cd3-4bdb-8839-2e8b5fd9e9d9 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:40.226741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1325/2654] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:34:40.576039 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870489-09dd-4f88-877c-170f3845ed11 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:40.576309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870489-09dd-4f88-877c-170f3845ed11 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:40.576648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870489-09dd-4f88-877c-170f3845ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:40.727865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0e870489-09dd-4f88-877c-170f3845ed11 None None] MFA Rules not processed for user `53d237d0049541999d292b88d851e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:40.729114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0e870489-09dd-4f88-877c-170f3845ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:40.737061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1330/2655] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 26 07:34:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:40.749314 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b0cd7-2cd3-4bdb-8839-2e8b5fd9e9d9 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:40.761021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b0cd7-2cd3-4bdb-8839-2e8b5fd9e9d9 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:40.767283 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7942c62-c5ff-4cda-8674-44d28c3a0d9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a03e5f2dee4bdeac26236d8127588c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:40.767911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7942c62-c5ff-4cda-8674-44d28c3a0d9d service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:40.768204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7942c62-c5ff-4cda-8674-44d28c3a0d9d service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:40.768458 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7942c62-c5ff-4cda-8674-44d28c3a0d9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:40.777848 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7942c62-c5ff-4cda-8674-44d28c3a0d9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:40.779417 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7942c62-c5ff-4cda-8674-44d28c3a0d9d service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:40.788880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1326/2656] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 26 07:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:34:40.907104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870489-09dd-4f88-877c-170f3845ed11 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:40.911848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0e870489-09dd-4f88-877c-170f3845ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:40.921148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870489-09dd-4f88-877c-170f3845ed11 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:40.925714 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e6966-e57f-45f3-82f4-1abce0168a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:40.926361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6966-e57f-45f3-82f4-1abce0168a33 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:40.926628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6966-e57f-45f3-82f4-1abce0168a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:40.926890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6966-e57f-45f3-82f4-1abce0168a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:40.937243 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:41.007412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e6966-e57f-45f3-82f4-1abce0168a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:41.009097 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e6966-e57f-45f3-82f4-1abce0168a33 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:41.025992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1331/2657] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:41.657176 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7942c62-c5ff-4cda-8674-44d28c3a0d9d service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:41.667394 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7942c62-c5ff-4cda-8674-44d28c3a0d9d service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:41.675743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bb362-325d-437a-94d0-00726572d10f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:41.676470 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bb362-325d-437a-94d0-00726572d10f service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:41.676947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bb362-325d-437a-94d0-00726572d10f service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:41.677296 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bb362-325d-437a-94d0-00726572d10f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:41.687195 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bb362-325d-437a-94d0-00726572d10f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:41.688637 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bb362-325d-437a-94d0-00726572d10f service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:41.700762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1327/2658] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:42.359120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e6966-e57f-45f3-82f4-1abce0168a33 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:42.361124 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fe2e6966-e57f-45f3-82f4-1abce0168a33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:42.438974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e6966-e57f-45f3-82f4-1abce0168a33 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:42.442935 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2018188-3bf3-496e-b535-ba75b61c2ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:42.443593 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018188-3bf3-496e-b535-ba75b61c2ded service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:42.443870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018188-3bf3-496e-b535-ba75b61c2ded service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:42.444152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018188-3bf3-496e-b535-ba75b61c2ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:42.446359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c2018188-3bf3-496e-b535-ba75b61c2ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:42.525809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2018188-3bf3-496e-b535-ba75b61c2ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:42.527271 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2018188-3bf3-496e-b535-ba75b61c2ded service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:42.538344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1332/2659] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:43.078378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bb362-325d-437a-94d0-00726572d10f service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:43.080869 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-726bb362-325d-437a-94d0-00726572d10f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:43.110755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bb362-325d-437a-94d0-00726572d10f service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:43.117326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:43.118585 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:43.118707 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:43.119404 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] PATH_INFO: `/v3/users/e72c20514e14423484a74405ba6eaeb9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:43.120893 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72c20514e14423484a74405ba6eaeb9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:43.123279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:43.185854 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72c20514e14423484a74405ba6eaeb9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.194885 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72c20514e14423484a74405ba6eaeb9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.210384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72c20514e14423484a74405ba6eaeb9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.218123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72c20514e14423484a74405ba6eaeb9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.219024 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72c20514e14423484a74405ba6eaeb9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.227268 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1328/2660] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:43 2022] DELETE /identity/v3/users/e72c20514e14423484a74405ba6eaeb9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:43.233119 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7caad6-b533-42d0-96a8-4b52bab25ca5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:43.233740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7caad6-b533-42d0-96a8-4b52bab25ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:43.234322 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7caad6-b533-42d0-96a8-4b52bab25ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:43.261375 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9f7caad6-b533-42d0-96a8-4b52bab25ca5 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:43.262981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f7caad6-b533-42d0-96a8-4b52bab25ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:43.324627 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:43.333912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1333/2661] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:43.344638 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:43.346415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:43.571945 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db158-8655-4354-baea-c34060995bd6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:43.578329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657bdce-e10f-40e4-8dfe-cf81a89b82b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:43.578904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657bdce-e10f-40e4-8dfe-cf81a89b82b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:43.579206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657bdce-e10f-40e4-8dfe-cf81a89b82b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:43.580128 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657bdce-e10f-40e4-8dfe-cf81a89b82b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:43.594001 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657bdce-e10f-40e4-8dfe-cf81a89b82b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:43.595554 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657bdce-e10f-40e4-8dfe-cf81a89b82b5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:43.613832 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1329/2662] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:43.795344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7caad6-b533-42d0-96a8-4b52bab25ca5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:43.798655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f7caad6-b533-42d0-96a8-4b52bab25ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:43.818312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7caad6-b533-42d0-96a8-4b52bab25ca5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:43.824597 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:43.825402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:43.825776 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:43.826298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] PATH_INFO: `/v3/projects/b90bc89a74094bd4b69191391292fdc1` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:43.827558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90bc89a74094bd4b69191391292fdc1)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:43.829726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:43.889043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90bc89a74094bd4b69191391292fdc1', 'request_id': 'req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.904310 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90bc89a74094bd4b69191391292fdc1', 'request_id': 'req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.911946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90bc89a74094bd4b69191391292fdc1', 'request_id': 'req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.923227 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] The token cache is being invalidate because project b90bc89a74094bd4b69191391292fdc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:43.923658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.925889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0c572d94-fa9d-42b6-a1aa-c7bd4fde0442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:43.927475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1334/2663] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:43 2022] DELETE /identity/v3/projects/b90bc89a74094bd4b69191391292fdc1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:45.668030 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657bdce-e10f-40e4-8dfe-cf81a89b82b5 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:45.669930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6657bdce-e10f-40e4-8dfe-cf81a89b82b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:45.683544 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657bdce-e10f-40e4-8dfe-cf81a89b82b5 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:45.702212 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:45.751903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:45.752469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:45.752748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:45.753048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] PATH_INFO: `/v3/users/d4ebd20bb18d4073b3d75561bd68b552` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:45.754378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ebd20bb18d4073b3d75561bd68b552)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:45.756439 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:45.844330 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ebd20bb18d4073b3d75561bd68b552'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:45.853987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ebd20bb18d4073b3d75561bd68b552'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:45.874730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ebd20bb18d4073b3d75561bd68b552'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:45.882454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ebd20bb18d4073b3d75561bd68b552'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:45.883192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ebd20bb18d4073b3d75561bd68b552'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:45.890548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1330/2664] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:45 2022] DELETE /identity/v3/users/d4ebd20bb18d4073b3d75561bd68b552 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:45.895114 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643056-2ea1-45ff-8bdb-90d7cd9590e0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:45.895558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643056-2ea1-45ff-8bdb-90d7cd9590e0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:45.895813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643056-2ea1-45ff-8bdb-90d7cd9590e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:45.910403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:45.911611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:45.923888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a3643056-2ea1-45ff-8bdb-90d7cd9590e0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:45.925215 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a3643056-2ea1-45ff-8bdb-90d7cd9590e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.005247 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1335/2665] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:46.006299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643056-2ea1-45ff-8bdb-90d7cd9590e0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:46.006740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048dcd4-4adb-4a9f-93d0-6cec89acda4d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.009473 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a3643056-2ea1-45ff-8bdb-90d7cd9590e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.018206 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.018939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.019293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.019484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.021581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.024214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643056-2ea1-45ff-8bdb-90d7cd9590e0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.032155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.032831 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.033106 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.033419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] PATH_INFO: `/v3/users/4a31e0a8824e44c288526ddd0b750394` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.034621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a31e0a8824e44c288526ddd0b750394)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.036588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:46.037279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.038911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:46.049158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1331/2666] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:34:46.050280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:46.051710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.085710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:46.094029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a31e0a8824e44c288526ddd0b750394'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.094706 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a31e0a8824e44c288526ddd0b750394'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.095358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a31e0a8824e44c288526ddd0b750394'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.107991 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a31e0a8824e44c288526ddd0b750394'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.115647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a31e0a8824e44c288526ddd0b750394'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.119252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a07d4-9fe0-4a44-8273-6b40a740d80c service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.121936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:46.122952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.123732 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.124111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.124410 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.126320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.132471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1336/2667] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:46 2022] DELETE /identity/v3/users/4a31e0a8824e44c288526ddd0b750394 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:46.144752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.146377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:46.158403 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1332/2668] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:46.330439 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:46.331969 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.412590 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4df4b-3af7-47cd-a148-9a5021e1b24e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.417358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.418017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.418293 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.418562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] PATH_INFO: `/v3/projects/913da9651ce94659a39eba25e76cc93e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.419797 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913da9651ce94659a39eba25e76cc93e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.421830 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:46.462046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:46.463530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.476064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913da9651ce94659a39eba25e76cc93e', 'request_id': 'req-195182de-c9bb-49c8-80c7-a71ac3a44cb1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.485581 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913da9651ce94659a39eba25e76cc93e', 'request_id': 'req-195182de-c9bb-49c8-80c7-a71ac3a44cb1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.493500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913da9651ce94659a39eba25e76cc93e', 'request_id': 'req-195182de-c9bb-49c8-80c7-a71ac3a44cb1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.494112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be422c4f-117b-402e-b698-cfc6b9e64324 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.506600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] The token cache is being invalidate because project 913da9651ce94659a39eba25e76cc93e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:46.506889 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.507577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-195182de-c9bb-49c8-80c7-a71ac3a44cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.509539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1337/2669] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:46 2022] DELETE /identity/v3/projects/913da9651ce94659a39eba25e76cc93e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:46.514867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b911b-44bb-40f5-b727-e88d7603378b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.515181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b911b-44bb-40f5-b727-e88d7603378b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.515785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b911b-44bb-40f5-b727-e88d7603378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.535304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-059b911b-44bb-40f5-b727-e88d7603378b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:46.536531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-059b911b-44bb-40f5-b727-e88d7603378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.558834 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.559483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.559758 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.560033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] PATH_INFO: `/v3/projects/aed00274eed6462ab8add929ba8c1f5c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.561213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed00274eed6462ab8add929ba8c1f5c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.563293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:46.599605 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1338/2670] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:46.608719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd867b-59af-4728-8b08-45ef1f2aa539 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.609057 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd867b-59af-4728-8b08-45ef1f2aa539 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.609349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd867b-59af-4728-8b08-45ef1f2aa539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.617316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed00274eed6462ab8add929ba8c1f5c', 'request_id': 'req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.626467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed00274eed6462ab8add929ba8c1f5c', 'request_id': 'req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.632720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-32cd867b-59af-4728-8b08-45ef1f2aa539 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:46.634153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-32cd867b-59af-4728-8b08-45ef1f2aa539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.637233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed00274eed6462ab8add929ba8c1f5c', 'request_id': 'req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.649392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] The token cache is being invalidate because project aed00274eed6462ab8add929ba8c1f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:46.649875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.650426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.652052 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1333/2671] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:46 2022] DELETE /identity/v3/projects/aed00274eed6462ab8add929ba8c1f5c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:46.655999 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:46.657447 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.658181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:46.711141 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1339/2672] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:46.715433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd867b-59af-4728-8b08-45ef1f2aa539 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:46.729304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd867b-59af-4728-8b08-45ef1f2aa539 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.734226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:46.737006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794aa63-898f-4fbc-b8b1-75b621412933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.737755 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794aa63-898f-4fbc-b8b1-75b621412933 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.738035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794aa63-898f-4fbc-b8b1-75b621412933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.738138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863a7b4-64e3-4cbe-ac3f-b0c3931adf90 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.738308 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794aa63-898f-4fbc-b8b1-75b621412933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.739018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794aa63-898f-4fbc-b8b1-75b621412933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:34:46.739336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794aa63-898f-4fbc-b8b1-75b621412933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.741074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794aa63-898f-4fbc-b8b1-75b621412933 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:46.745518 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.747000 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.747454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.747908 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] PATH_INFO: `/v3/users/93048114c47b40fda453851407378d2d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.749198 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=93048114c47b40fda453851407378d2d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.751422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:46.753834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1340/2673] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:34:46.758305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794aa63-898f-4fbc-b8b1-75b621412933 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:46.768404 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794aa63-898f-4fbc-b8b1-75b621412933 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.773978 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1abb3-595b-4c22-87bf-406418f78858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.774594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1abb3-595b-4c22-87bf-406418f78858 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.774873 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1abb3-595b-4c22-87bf-406418f78858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.775146 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1abb3-595b-4c22-87bf-406418f78858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.775817 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1abb3-595b-4c22-87bf-406418f78858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.777788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1abb3-595b-4c22-87bf-406418f78858 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:46.802858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93048114c47b40fda453851407378d2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.806125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1341/2674] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:46 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:34:46.810299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1abb3-595b-4c22-87bf-406418f78858 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:46.814606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93048114c47b40fda453851407378d2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.828429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93048114c47b40fda453851407378d2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.836007 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93048114c47b40fda453851407378d2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.836729 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93048114c47b40fda453851407378d2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:46.842785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1334/2675] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:46 2022] DELETE /identity/v3/users/93048114c47b40fda453851407378d2d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:46.874631 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1abb3-595b-4c22-87bf-406418f78858 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.935929 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641488a6-f74e-4b7e-9bbb-e05fdf4cddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.936607 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641488a6-f74e-4b7e-9bbb-e05fdf4cddeb admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.936958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641488a6-f74e-4b7e-9bbb-e05fdf4cddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.937153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641488a6-f74e-4b7e-9bbb-e05fdf4cddeb admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.937864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641488a6-f74e-4b7e-9bbb-e05fdf4cddeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.939806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641488a6-f74e-4b7e-9bbb-e05fdf4cddeb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:46.962259 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1342/2676] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:46 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:34:46.966728 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:46.968558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:46.982810 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5575-51ca-4d0e-9dd6-d41a97eb5c5a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:46.988377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27826abc-44c2-4f41-bede-0fdda88c4c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:46.989011 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27826abc-44c2-4f41-bede-0fdda88c4c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:46.989399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27826abc-44c2-4f41-bede-0fdda88c4c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:46.989737 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27826abc-44c2-4f41-bede-0fdda88c4c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:46.993602 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27826abc-44c2-4f41-bede-0fdda88c4c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:46.995272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27826abc-44c2-4f41-bede-0fdda88c4c72 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.007692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1335/2677] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:47.012065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641488a6-f74e-4b7e-9bbb-e05fdf4cddeb admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.022500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641488a6-f74e-4b7e-9bbb-e05fdf4cddeb admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.027723 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284f91b-016e-422d-8f3e-dd0896ca192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.028523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284f91b-016e-422d-8f3e-dd0896ca192d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.028865 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284f91b-016e-422d-8f3e-dd0896ca192d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.029173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284f91b-016e-422d-8f3e-dd0896ca192d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.029924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284f91b-016e-422d-8f3e-dd0896ca192d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.031880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284f91b-016e-422d-8f3e-dd0896ca192d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.043311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1343/2678] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:47.047955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27826abc-44c2-4f41-bede-0fdda88c4c72 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.059388 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27826abc-44c2-4f41-bede-0fdda88c4c72 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.065510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d0a7c-b436-4b30-8404-58fc3d3c03e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.066180 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0a7c-b436-4b30-8404-58fc3d3c03e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.066471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0a7c-b436-4b30-8404-58fc3d3c03e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.066741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0a7c-b436-4b30-8404-58fc3d3c03e3 admin admin] PATH_INFO: `/v3/projects/8563cfa91acc4410a2b512dbc9bf813f/users/2b907343ee204fffa6e80111f560524b/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.086688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d0a7c-b436-4b30-8404-58fc3d3c03e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8563cfa91acc4410a2b512dbc9bf813f, user_id=2b907343ee204fffa6e80111f560524b, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.091407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d0a7c-b436-4b30-8404-58fc3d3c03e3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.110386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1336/2679] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:47 2022] PUT /identity/v3/projects/8563cfa91acc4410a2b512dbc9bf813f/users/2b907343ee204fffa6e80111f560524b/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:47.123365 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714ddf-6861-4097-9d26-da7b82c250ba None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.123852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714ddf-6861-4097-9d26-da7b82c250ba None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.124166 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714ddf-6861-4097-9d26-da7b82c250ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.142328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d0a7c-b436-4b30-8404-58fc3d3c03e3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.144082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2d4d0a7c-b436-4b30-8404-58fc3d3c03e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:47.155584 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3c714ddf-6861-4097-9d26-da7b82c250ba None None] MFA Rules not processed for user `2b907343ee204fffa6e80111f560524b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:47.156962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3c714ddf-6861-4097-9d26-da7b82c250ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:47.164589 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:47.219744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d0a7c-b436-4b30-8404-58fc3d3c03e3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.224382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.225036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.225341 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.225617 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] PATH_INFO: `/v3/projects/e2daf1bf4e7344d886a275ccc7134ef1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.226800 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2daf1bf4e7344d886a275ccc7134ef1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.228787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.230784 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1344/2680] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:47.236409 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c714ddf-6861-4097-9d26-da7b82c250ba None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.247601 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c714ddf-6861-4097-9d26-da7b82c250ba None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.252862 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388151c6-faad-42e7-9fa3-e7d80bd12d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.253531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388151c6-faad-42e7-9fa3-e7d80bd12d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.253813 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388151c6-faad-42e7-9fa3-e7d80bd12d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.254089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388151c6-faad-42e7-9fa3-e7d80bd12d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.254852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388151c6-faad-42e7-9fa3-e7d80bd12d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.256906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388151c6-faad-42e7-9fa3-e7d80bd12d86 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.274968 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:47.279460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2daf1bf4e7344d886a275ccc7134ef1', 'request_id': 'req-816790a9-cbef-4072-8e33-e6dc7c050517'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.287431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1345/2681] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:47 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:47.290913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2daf1bf4e7344d886a275ccc7134ef1', 'request_id': 'req-816790a9-cbef-4072-8e33-e6dc7c050517'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.292034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388151c6-faad-42e7-9fa3-e7d80bd12d86 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.300422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2daf1bf4e7344d886a275ccc7134ef1', 'request_id': 'req-816790a9-cbef-4072-8e33-e6dc7c050517'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.312596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] The token cache is being invalidate because project e2daf1bf4e7344d886a275ccc7134ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:47.313163 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.314069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.315849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1337/2682] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:47 2022] DELETE /identity/v3/projects/e2daf1bf4e7344d886a275ccc7134ef1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:47.320108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.321799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:47.364010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388151c6-faad-42e7-9fa3-e7d80bd12d86 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.368974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa7600-daab-411d-aaf0-6966a4f859a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.369648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa7600-daab-411d-aaf0-6966a4f859a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.369931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa7600-daab-411d-aaf0-6966a4f859a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.370203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa7600-daab-411d-aaf0-6966a4f859a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.370886 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa7600-daab-411d-aaf0-6966a4f859a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.372857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa7600-daab-411d-aaf0-6966a4f859a4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.392460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816790a9-cbef-4072-8e33-e6dc7c050517 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.397133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1346/2683] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:47 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:47.398415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.399108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.399392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.399668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] PATH_INFO: `/v3/users/dd6d095e1ae749ffad8cfb9d0ea07e08` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.401651 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6d095e1ae749ffad8cfb9d0ea07e08)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.402656 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa7600-daab-411d-aaf0-6966a4f859a4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.403636 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.404758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-04fa7600-daab-411d-aaf0-6966a4f859a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:47.417118 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa7600-daab-411d-aaf0-6966a4f859a4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.422164 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568617-9779-4d43-aa85-8592b80ec115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.422803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568617-9779-4d43-aa85-8592b80ec115 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.423088 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568617-9779-4d43-aa85-8592b80ec115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.423359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568617-9779-4d43-aa85-8592b80ec115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.424072 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568617-9779-4d43-aa85-8592b80ec115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.425717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568617-9779-4d43-aa85-8592b80ec115 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.440742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1347/2684] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:34:47.442234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568617-9779-4d43-aa85-8592b80ec115 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.452327 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568617-9779-4d43-aa85-8592b80ec115 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.454165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6d095e1ae749ffad8cfb9d0ea07e08'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.457576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39e35-470c-41c5-85b8-7114218aebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.458276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39e35-470c-41c5-85b8-7114218aebdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.458552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39e35-470c-41c5-85b8-7114218aebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.458829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39e35-470c-41c5-85b8-7114218aebdd admin admin] PATH_INFO: `/v3/projects/2c0046e20cda4858961eee8c37f74f63/users/5f15db80cc684b26a027237fe38e6600/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.462328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6d095e1ae749ffad8cfb9d0ea07e08'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.474176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c39e35-470c-41c5-85b8-7114218aebdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0046e20cda4858961eee8c37f74f63, user_id=5f15db80cc684b26a027237fe38e6600, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.475140 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6d095e1ae749ffad8cfb9d0ea07e08'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.477081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c39e35-470c-41c5-85b8-7114218aebdd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.482043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6d095e1ae749ffad8cfb9d0ea07e08'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.482842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6d095e1ae749ffad8cfb9d0ea07e08'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.488913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1338/2685] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:34:47 2022] DELETE /identity/v3/users/dd6d095e1ae749ffad8cfb9d0ea07e08 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:47.494523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1348/2686] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:47 2022] PUT /identity/v3/projects/2c0046e20cda4858961eee8c37f74f63/users/5f15db80cc684b26a027237fe38e6600/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:47.498504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.500029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:47.561788 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:47.578595 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd081a9-c98c-40dc-974f-3b20898c79f9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.584237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aa7dd-61c5-43ee-8597-ab5347308da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.584888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa7dd-61c5-43ee-8597-ab5347308da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.585165 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa7dd-61c5-43ee-8597-ab5347308da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.585465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa7dd-61c5-43ee-8597-ab5347308da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.586178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844aa7dd-61c5-43ee-8597-ab5347308da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.587807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844aa7dd-61c5-43ee-8597-ab5347308da2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.599921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1339/2687] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:34:47.604614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39e35-470c-41c5-85b8-7114218aebdd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.657924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:47.679047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39e35-470c-41c5-85b8-7114218aebdd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.683781 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58f94-40e9-4108-a753-69988000b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.684465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58f94-40e9-4108-a753-69988000b28a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.684747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58f94-40e9-4108-a753-69988000b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.685018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58f94-40e9-4108-a753-69988000b28a admin admin] PATH_INFO: `/v3/projects/2c0046e20cda4858961eee8c37f74f63/users/5f15db80cc684b26a027237fe38e6600/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.687183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58f94-40e9-4108-a753-69988000b28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0046e20cda4858961eee8c37f74f63, user_id=5f15db80cc684b26a027237fe38e6600, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.689888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58f94-40e9-4108-a753-69988000b28a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.701234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1349/2688] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:47 2022] PUT /identity/v3/projects/2c0046e20cda4858961eee8c37f74f63/users/5f15db80cc684b26a027237fe38e6600/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:47.712166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e66645-9bba-4d5c-96d4-610c3b169233 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.712166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e66645-9bba-4d5c-96d4-610c3b169233 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.712506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e66645-9bba-4d5c-96d4-610c3b169233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.744263 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-71e66645-9bba-4d5c-96d4-610c3b169233 None None] MFA Rules not processed for user `5f15db80cc684b26a027237fe38e6600`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:47.745946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-71e66645-9bba-4d5c-96d4-610c3b169233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:47.795758 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58f94-40e9-4108-a753-69988000b28a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.797899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-27e58f94-40e9-4108-a753-69988000b28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:47.827387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1340/2689] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:47.839034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e66645-9bba-4d5c-96d4-610c3b169233 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:47.840432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-71e66645-9bba-4d5c-96d4-610c3b169233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:47.872923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58f94-40e9-4108-a753-69988000b28a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.878494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.879138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.879465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.879740 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] PATH_INFO: `/v3/projects/fa543d83ac1040c5a1da2a1861b343de` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.880915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa543d83ac1040c5a1da2a1861b343de)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.882925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.899928 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e66645-9bba-4d5c-96d4-610c3b169233 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:47.903752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92d673-222b-443f-bc03-dee079044f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:47.904376 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92d673-222b-443f-bc03-dee079044f4e service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.904652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92d673-222b-443f-bc03-dee079044f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.904958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92d673-222b-443f-bc03-dee079044f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.914879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92d673-222b-443f-bc03-dee079044f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:47.916373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92d673-222b-443f-bc03-dee079044f4e service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:47.926096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1341/2690] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:34:47.930684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa543d83ac1040c5a1da2a1861b343de', 'request_id': 'req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.939728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa543d83ac1040c5a1da2a1861b343de', 'request_id': 'req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.946609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa543d83ac1040c5a1da2a1861b343de', 'request_id': 'req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.963196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] The token cache is being invalidate because project fa543d83ac1040c5a1da2a1861b343de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:34:47.963487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.964214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:34:47.966035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1350/2691] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:34:47 2022] DELETE /identity/v3/projects/fa543d83ac1040c5a1da2a1861b343de => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:34:47.972162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337824-ae19-4cf1-9076-7c9f32169f78 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:47.972521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337824-ae19-4cf1-9076-7c9f32169f78 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:47.972937 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337824-ae19-4cf1-9076-7c9f32169f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:47.994041 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2f337824-ae19-4cf1-9076-7c9f32169f78 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:47.995288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2f337824-ae19-4cf1-9076-7c9f32169f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:48.006104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:48.007050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:48.057169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1342/2692] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:48.065343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac555c5-7413-4dbb-b2fb-03ba523f26f2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.065551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9dc9-4e4f-45dc-86e8-31f7c75f24a4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:48.065720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac555c5-7413-4dbb-b2fb-03ba523f26f2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.065934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac555c5-7413-4dbb-b2fb-03ba523f26f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.069287 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be0eab-fa71-486a-a1d1-d5b0f3a4054f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:48.070286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be0eab-fa71-486a-a1d1-d5b0f3a4054f service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.070563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be0eab-fa71-486a-a1d1-d5b0f3a4054f service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.070828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be0eab-fa71-486a-a1d1-d5b0f3a4054f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.072659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d9be0eab-fa71-486a-a1d1-d5b0f3a4054f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:48.085679 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fac555c5-7413-4dbb-b2fb-03ba523f26f2 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:48.086880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fac555c5-7413-4dbb-b2fb-03ba523f26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:48.091611 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:48.095186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1343/2693] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:34:48.099486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac555c5-7413-4dbb-b2fb-03ba523f26f2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:48.108378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac555c5-7413-4dbb-b2fb-03ba523f26f2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:48.113063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a53e4-04eb-4ff9-8ee0-15dcc2da879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:48.113703 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a53e4-04eb-4ff9-8ee0-15dcc2da879c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.113977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a53e4-04eb-4ff9-8ee0-15dcc2da879c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.114261 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a53e4-04eb-4ff9-8ee0-15dcc2da879c admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.114938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a53e4-04eb-4ff9-8ee0-15dcc2da879c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:34:48.115232 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a53e4-04eb-4ff9-8ee0-15dcc2da879c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:48.116802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a53e4-04eb-4ff9-8ee0-15dcc2da879c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:48.119958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:48.129641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1344/2694] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:34:48.133900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a53e4-04eb-4ff9-8ee0-15dcc2da879c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:48.139080 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be0eab-fa71-486a-a1d1-d5b0f3a4054f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:48.140680 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be0eab-fa71-486a-a1d1-d5b0f3a4054f service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:48.143374 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a53e4-04eb-4ff9-8ee0-15dcc2da879c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:48.148449 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5062386-cccf-4d22-8803-95b846c27548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:48.149094 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5062386-cccf-4d22-8803-95b846c27548 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.149431 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5062386-cccf-4d22-8803-95b846c27548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.149754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5062386-cccf-4d22-8803-95b846c27548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.150479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5062386-cccf-4d22-8803-95b846c27548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:48.150614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1351/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:34:48.152559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5062386-cccf-4d22-8803-95b846c27548 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:48.184138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1345/2696] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:34:48 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:34:48.188402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be0eab-fa71-486a-a1d1-d5b0f3a4054f service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:48.201342 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be0eab-fa71-486a-a1d1-d5b0f3a4054f service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:48.266304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df05ec-b9be-43ba-948a-9fe9219707cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:48.266946 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df05ec-b9be-43ba-948a-9fe9219707cd admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.267226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df05ec-b9be-43ba-948a-9fe9219707cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.267514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df05ec-b9be-43ba-948a-9fe9219707cd admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.268354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df05ec-b9be-43ba-948a-9fe9219707cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:48.270390 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df05ec-b9be-43ba-948a-9fe9219707cd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:48.294437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1352/2697] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:34:48 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:34:48.298541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5062386-cccf-4d22-8803-95b846c27548 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:48.308700 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5062386-cccf-4d22-8803-95b846c27548 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:48.313190 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcafb9-7967-4500-b1b5-6d8cd10f24b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:48.313833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcafb9-7967-4500-b1b5-6d8cd10f24b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.314108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcafb9-7967-4500-b1b5-6d8cd10f24b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.314373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcafb9-7967-4500-b1b5-6d8cd10f24b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.315074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcafb9-7967-4500-b1b5-6d8cd10f24b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:48.316668 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcafb9-7967-4500-b1b5-6d8cd10f24b9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:48.327020 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1346/2698] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:34:48.331026 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df05ec-b9be-43ba-948a-9fe9219707cd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:48.341203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df05ec-b9be-43ba-948a-9fe9219707cd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:48.346350 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e678a-e1b1-40be-94bf-1b7cc3269a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:48.347029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e678a-e1b1-40be-94bf-1b7cc3269a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.347304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e678a-e1b1-40be-94bf-1b7cc3269a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.347576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e678a-e1b1-40be-94bf-1b7cc3269a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.348384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e678a-e1b1-40be-94bf-1b7cc3269a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:48.350035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e678a-e1b1-40be-94bf-1b7cc3269a85 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:48.362537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1353/2699] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:34:48.367441 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcafb9-7967-4500-b1b5-6d8cd10f24b9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:48.378965 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcafb9-7967-4500-b1b5-6d8cd10f24b9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:48.384760 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823b6f5-6986-4afb-a51c-b672ab46226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:48.385622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b6f5-6986-4afb-a51c-b672ab46226d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.385899 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b6f5-6986-4afb-a51c-b672ab46226d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.386160 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b6f5-6986-4afb-a51c-b672ab46226d admin admin] PATH_INFO: `/v3/projects/86ee0e4119314438be2f1855d52e26ae/users/52123d6a3694456a9a29c8987ec62bd6/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.404584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823b6f5-6986-4afb-a51c-b672ab46226d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ee0e4119314438be2f1855d52e26ae, user_id=52123d6a3694456a9a29c8987ec62bd6, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:48.407264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823b6f5-6986-4afb-a51c-b672ab46226d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:48.423291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1347/2700] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:34:48 2022] PUT /identity/v3/projects/86ee0e4119314438be2f1855d52e26ae/users/52123d6a3694456a9a29c8987ec62bd6/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:34:48.428980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d359-082b-4ab3-9e2b-e8fd8240a9cc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.429333 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d359-082b-4ab3-9e2b-e8fd8240a9cc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.429574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d359-082b-4ab3-9e2b-e8fd8240a9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.451416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9e28d359-082b-4ab3-9e2b-e8fd8240a9cc None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:48.452834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9e28d359-082b-4ab3-9e2b-e8fd8240a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:48.520131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1354/2701] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:48.530186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823b6f5-6986-4afb-a51c-b672ab46226d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:48.532483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6823b6f5-6986-4afb-a51c-b672ab46226d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:48.595497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823b6f5-6986-4afb-a51c-b672ab46226d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:48.600143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bccd90-acf6-4355-a062-f16a184b92f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:48.600761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bccd90-acf6-4355-a062-f16a184b92f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:48.601038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bccd90-acf6-4355-a062-f16a184b92f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:48.601302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bccd90-acf6-4355-a062-f16a184b92f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:48.615363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bccd90-acf6-4355-a062-f16a184b92f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:48.617477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bccd90-acf6-4355-a062-f16a184b92f9 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:48.630201 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1348/2702] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:49.364374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9c77d-1177-4f4f-99a0-56f3808e8282 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:49.365014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9c77d-1177-4f4f-99a0-56f3808e8282 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:49.365014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9c77d-1177-4f4f-99a0-56f3808e8282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:49.394883 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d4a9c77d-1177-4f4f-99a0-56f3808e8282 None None] MFA Rules not processed for user `52123d6a3694456a9a29c8987ec62bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:49.396131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d4a9c77d-1177-4f4f-99a0-56f3808e8282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:49.434983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:34:49.487289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1355/2703] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:49.499468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bccd90-acf6-4355-a062-f16a184b92f9 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:49.565254 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bccd90-acf6-4355-a062-f16a184b92f9 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:49.568899 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc6499-83b7-44f8-8cc7-7fc48f5dff92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:49.569949 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc6499-83b7-44f8-8cc7-7fc48f5dff92 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:49.570218 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc6499-83b7-44f8-8cc7-7fc48f5dff92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:49.570552 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc6499-83b7-44f8-8cc7-7fc48f5dff92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:49.580213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc6499-83b7-44f8-8cc7-7fc48f5dff92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:49.581990 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc6499-83b7-44f8-8cc7-7fc48f5dff92 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:49.591222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1349/2704] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:34:51.002461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8831f1-a4d9-41da-8ec5-dcd872574a4d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:51.003063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8831f1-a4d9-41da-8ec5-dcd872574a4d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:51.003063 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8831f1-a4d9-41da-8ec5-dcd872574a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:51.025646 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5d8831f1-a4d9-41da-8ec5-dcd872574a4d None None] MFA Rules not processed for user `52123d6a3694456a9a29c8987ec62bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:34:51.026938 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5d8831f1-a4d9-41da-8ec5-dcd872574a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:51.035529 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1356/2705] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:34:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:34:51.291435 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc6499-83b7-44f8-8cc7-7fc48f5dff92 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:34:51.293005 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-80cc6499-83b7-44f8-8cc7-7fc48f5dff92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:51.305875 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc6499-83b7-44f8-8cc7-7fc48f5dff92 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:34:51.309903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f669a8-89ee-4977-9e35-980d5f97fd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:34:51.310467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f669a8-89ee-4977-9e35-980d5f97fd50 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:34:51.310750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f669a8-89ee-4977-9e35-980d5f97fd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:34:51.311018 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f669a8-89ee-4977-9e35-980d5f97fd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:34:51.313098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-97f669a8-89ee-4977-9e35-980d5f97fd50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:34:51.323955 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f669a8-89ee-4977-9e35-980d5f97fd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:34:51.325438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f669a8-89ee-4977-9e35-980d5f97fd50 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:34:51.334040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1350/2706] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:34:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:01.018282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=18 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:01.330022 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=84,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:18.040047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8831f1-a4d9-41da-8ec5-dcd872574a4d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:18.041632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5d8831f1-a4d9-41da-8ec5-dcd872574a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:18.056006 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8831f1-a4d9-41da-8ec5-dcd872574a4d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:18.061139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:18.061998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:18.062449 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:18.062736 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] PATH_INFO: `/v3/users/2b907343ee204fffa6e80111f560524b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:18.063943 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b907343ee204fffa6e80111f560524b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:18.065912 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:18.124190 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b907343ee204fffa6e80111f560524b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.125002 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b907343ee204fffa6e80111f560524b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.125875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b907343ee204fffa6e80111f560524b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.139845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b907343ee204fffa6e80111f560524b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.149810 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b907343ee204fffa6e80111f560524b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.163848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1357/2707] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:18 2022] DELETE /identity/v3/users/2b907343ee204fffa6e80111f560524b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:18.168557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507252d-6c9a-4aff-bd95-a85326706f73 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:18.169057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507252d-6c9a-4aff-bd95-a85326706f73 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:18.169153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507252d-6c9a-4aff-bd95-a85326706f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:18.188267 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3507252d-6c9a-4aff-bd95-a85326706f73 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:18.189513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3507252d-6c9a-4aff-bd95-a85326706f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:18.252492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1351/2708] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:18.263159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:18.264927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:18.337299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dbe25-a061-4ea8-a40c-0b52bb237591 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:18.341568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279df198-e2cd-42ee-9537-500918dffeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:18.342223 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279df198-e2cd-42ee-9537-500918dffeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:18.342483 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279df198-e2cd-42ee-9537-500918dffeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:18.342753 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279df198-e2cd-42ee-9537-500918dffeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:18.352750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279df198-e2cd-42ee-9537-500918dffeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:18.354275 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279df198-e2cd-42ee-9537-500918dffeb0 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:18.364029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1358/2709] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:18.456228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561d192-892f-4d12-996a-6629f36885b3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:18.456701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561d192-892f-4d12-996a-6629f36885b3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:18.457139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561d192-892f-4d12-996a-6629f36885b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:18.483048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b561d192-892f-4d12-996a-6629f36885b3 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:18.484278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b561d192-892f-4d12-996a-6629f36885b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:18.494062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1352/2710] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:18.518924 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279df198-e2cd-42ee-9537-500918dffeb0 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:18.520061 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-279df198-e2cd-42ee-9537-500918dffeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:18.599972 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279df198-e2cd-42ee-9537-500918dffeb0 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:18.606643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80feaf-722e-4b0c-b53f-8d5d7d6d8798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:18.607305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80feaf-722e-4b0c-b53f-8d5d7d6d8798 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:18.607573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80feaf-722e-4b0c-b53f-8d5d7d6d8798 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:18.607847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80feaf-722e-4b0c-b53f-8d5d7d6d8798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:18.617441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80feaf-722e-4b0c-b53f-8d5d7d6d8798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:18.619156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80feaf-722e-4b0c-b53f-8d5d7d6d8798 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:18.624276 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:18.630045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1359/2711] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:18.676792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561d192-892f-4d12-996a-6629f36885b3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:18.678704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b561d192-892f-4d12-996a-6629f36885b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:18.704929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561d192-892f-4d12-996a-6629f36885b3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:18.712758 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:18.713882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:18.714231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:18.714648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] PATH_INFO: `/v3/projects/8563cfa91acc4410a2b512dbc9bf813f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:18.716562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8563cfa91acc4410a2b512dbc9bf813f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:18.718880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:18.771782 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8563cfa91acc4410a2b512dbc9bf813f', 'request_id': 'req-b8e85dde-daef-423e-bd32-025181929e90'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.780243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8563cfa91acc4410a2b512dbc9bf813f', 'request_id': 'req-b8e85dde-daef-423e-bd32-025181929e90'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.787042 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8563cfa91acc4410a2b512dbc9bf813f', 'request_id': 'req-b8e85dde-daef-423e-bd32-025181929e90'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.798678 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] The token cache is being invalidate because project 8563cfa91acc4410a2b512dbc9bf813f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:18.798962 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.799740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.801287 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1353/2712] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:18 2022] DELETE /identity/v3/projects/8563cfa91acc4410a2b512dbc9bf813f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:18.805621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80feaf-722e-4b0c-b53f-8d5d7d6d8798 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:18.816716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80feaf-722e-4b0c-b53f-8d5d7d6d8798 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:18.881944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:18.882592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:18.882868 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:18.883139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] PATH_INFO: `/v3/users/5f15db80cc684b26a027237fe38e6600` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:18.884312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f15db80cc684b26a027237fe38e6600)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:18.886370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:18.938397 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f15db80cc684b26a027237fe38e6600'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.939138 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f15db80cc684b26a027237fe38e6600'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.939815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f15db80cc684b26a027237fe38e6600'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.952902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f15db80cc684b26a027237fe38e6600'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.961577 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-79f06235-5b14-4878-9f34-ae41a1cb2d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f15db80cc684b26a027237fe38e6600'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:18.974446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1360/2713] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:18 2022] DELETE /identity/v3/users/5f15db80cc684b26a027237fe38e6600 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:19.265224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:19.266771 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:19.281243 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e85dde-daef-423e-bd32-025181929e90 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:19.339503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:19.340166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.340434 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.340710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] PATH_INFO: `/v3/projects/2c0046e20cda4858961eee8c37f74f63` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.343141 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0046e20cda4858961eee8c37f74f63)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:19.345100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:19.369184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:19.396956 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0046e20cda4858961eee8c37f74f63', 'request_id': 'req-955dd890-02ec-4426-8694-7b976ec3ebcb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:19.405928 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0046e20cda4858961eee8c37f74f63', 'request_id': 'req-955dd890-02ec-4426-8694-7b976ec3ebcb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:19.413831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0046e20cda4858961eee8c37f74f63', 'request_id': 'req-955dd890-02ec-4426-8694-7b976ec3ebcb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:19.427040 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] The token cache is being invalidate because project 2c0046e20cda4858961eee8c37f74f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:19.427364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:19.428058 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-955dd890-02ec-4426-8694-7b976ec3ebcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:19.429633 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1354/2714] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:19 2022] DELETE /identity/v3/projects/2c0046e20cda4858961eee8c37f74f63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:19.434807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204528e-1c05-4d73-b5c2-0d5961155b6a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.435316 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204528e-1c05-4d73-b5c2-0d5961155b6a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.435431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204528e-1c05-4d73-b5c2-0d5961155b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.456388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7204528e-1c05-4d73-b5c2-0d5961155b6a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:19.457681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7204528e-1c05-4d73-b5c2-0d5961155b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:19.528189 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1361/2715] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:19.536305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71fe85-a5a7-43b1-bc97-fec7ae71bf45 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.536598 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71fe85-a5a7-43b1-bc97-fec7ae71bf45 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.536898 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71fe85-a5a7-43b1-bc97-fec7ae71bf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.558740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4f71fe85-a5a7-43b1-bc97-fec7ae71bf45 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:19.559981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f71fe85-a5a7-43b1-bc97-fec7ae71bf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:19.570070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1355/2716] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:19.574595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204528e-1c05-4d73-b5c2-0d5961155b6a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:19.584842 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204528e-1c05-4d73-b5c2-0d5961155b6a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:19.590237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172e8cb-473c-46c4-9893-bbacede10e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:19.590852 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172e8cb-473c-46c4-9893-bbacede10e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.591131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172e8cb-473c-46c4-9893-bbacede10e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.591412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172e8cb-473c-46c4-9893-bbacede10e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.592105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172e8cb-473c-46c4-9893-bbacede10e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:35:19.592412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172e8cb-473c-46c4-9893-bbacede10e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:19.594060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172e8cb-473c-46c4-9893-bbacede10e41 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:19.605856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1362/2717] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:35:19.610352 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71fe85-a5a7-43b1-bc97-fec7ae71bf45 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:19.620566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71fe85-a5a7-43b1-bc97-fec7ae71bf45 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:19.627576 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c37a-e688-4dca-8629-a820f9c7b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:19.628217 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c37a-e688-4dca-8629-a820f9c7b005 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.628502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c37a-e688-4dca-8629-a820f9c7b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.628746 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c37a-e688-4dca-8629-a820f9c7b005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.629506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c37a-e688-4dca-8629-a820f9c7b005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:19.633047 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c37a-e688-4dca-8629-a820f9c7b005 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:19.675320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1356/2718] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:19 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:19.679381 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172e8cb-473c-46c4-9893-bbacede10e41 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:19.689829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172e8cb-473c-46c4-9893-bbacede10e41 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:19.697752 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:19.757659 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c2007-6c15-4f40-8267-42b57f83b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:19.758295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c2007-6c15-4f40-8267-42b57f83b8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.758579 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c2007-6c15-4f40-8267-42b57f83b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.758845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c2007-6c15-4f40-8267-42b57f83b8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.759621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c2007-6c15-4f40-8267-42b57f83b8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:19.761600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c2007-6c15-4f40-8267-42b57f83b8d9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:19.789856 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1363/2719] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:19 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:19.794454 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c37a-e688-4dca-8629-a820f9c7b005 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:19.805131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c37a-e688-4dca-8629-a820f9c7b005 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:19.811136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d007e6-671d-42f2-aab1-549cc0e20b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:19.811762 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d007e6-671d-42f2-aab1-549cc0e20b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.812046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d007e6-671d-42f2-aab1-549cc0e20b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.812347 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d007e6-671d-42f2-aab1-549cc0e20b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.813012 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d007e6-671d-42f2-aab1-549cc0e20b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:19.814738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d007e6-671d-42f2-aab1-549cc0e20b27 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:19.826057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1357/2720] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:35:19.830419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c2007-6c15-4f40-8267-42b57f83b8d9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:19.840618 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c2007-6c15-4f40-8267-42b57f83b8d9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:19.845563 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb62a14-ef3f-45d9-bb79-0e56e63444c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:19.846176 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb62a14-ef3f-45d9-bb79-0e56e63444c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.846450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb62a14-ef3f-45d9-bb79-0e56e63444c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.846717 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb62a14-ef3f-45d9-bb79-0e56e63444c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.847416 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb62a14-ef3f-45d9-bb79-0e56e63444c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:19.849010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb62a14-ef3f-45d9-bb79-0e56e63444c9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:19.859709 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1364/2721] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:19.864067 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d007e6-671d-42f2-aab1-549cc0e20b27 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:19.874224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d007e6-671d-42f2-aab1-549cc0e20b27 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:19.880104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0717d26-e719-488c-b26c-41ba50cd14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:19.880809 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0717d26-e719-488c-b26c-41ba50cd14a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.881090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0717d26-e719-488c-b26c-41ba50cd14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.881392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0717d26-e719-488c-b26c-41ba50cd14a1 admin admin] PATH_INFO: `/v3/projects/00c55c4185c34e318e640db7a95f1794/users/8d9c04db661d47ecb31fb9c602d2c442/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.898272 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0717d26-e719-488c-b26c-41ba50cd14a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c55c4185c34e318e640db7a95f1794, user_id=8d9c04db661d47ecb31fb9c602d2c442, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:19.900936 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0717d26-e719-488c-b26c-41ba50cd14a1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:19.916402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1358/2722] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:19 2022] PUT /identity/v3/projects/00c55c4185c34e318e640db7a95f1794/users/8d9c04db661d47ecb31fb9c602d2c442/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:19.928191 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a382cf-0950-4682-9b81-1e8abeae5457 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:19.928500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a382cf-0950-4682-9b81-1e8abeae5457 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:19.928792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a382cf-0950-4682-9b81-1e8abeae5457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:19.958173 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e9a382cf-0950-4682-9b81-1e8abeae5457 None None] MFA Rules not processed for user `8d9c04db661d47ecb31fb9c602d2c442`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:19.959393 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e9a382cf-0950-4682-9b81-1e8abeae5457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:20.031424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1365/2723] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:20.036506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0717d26-e719-488c-b26c-41ba50cd14a1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:20.101034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0717d26-e719-488c-b26c-41ba50cd14a1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:20.106610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1e36a-25b1-4130-b91b-928a30a8567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:20.107105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1e36a-25b1-4130-b91b-928a30a8567d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:20.107387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1e36a-25b1-4130-b91b-928a30a8567d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:20.107644 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1e36a-25b1-4130-b91b-928a30a8567d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:20.108311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1e36a-25b1-4130-b91b-928a30a8567d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:20.110323 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1e36a-25b1-4130-b91b-928a30a8567d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:20.142228 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1359/2724] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:20 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:20.147149 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a382cf-0950-4682-9b81-1e8abeae5457 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:20.160270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a382cf-0950-4682-9b81-1e8abeae5457 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:20.237152 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1d54-190e-4bc6-9533-e7beb4db3024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:20.237826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1d54-190e-4bc6-9533-e7beb4db3024 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:20.238144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1d54-190e-4bc6-9533-e7beb4db3024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:20.238410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1d54-190e-4bc6-9533-e7beb4db3024 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:20.239081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed1d54-190e-4bc6-9533-e7beb4db3024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:20.240999 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed1d54-190e-4bc6-9533-e7beb4db3024 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:20.264387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1366/2725] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:20 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:20.268689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1e36a-25b1-4130-b91b-928a30a8567d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:20.279814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1e36a-25b1-4130-b91b-928a30a8567d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:20.284573 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231dd39-aeb4-447d-bce1-e33934a6a52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:20.285199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231dd39-aeb4-447d-bce1-e33934a6a52f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:20.285511 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231dd39-aeb4-447d-bce1-e33934a6a52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:20.285784 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231dd39-aeb4-447d-bce1-e33934a6a52f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:20.286485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231dd39-aeb4-447d-bce1-e33934a6a52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:20.288090 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231dd39-aeb4-447d-bce1-e33934a6a52f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:20.298748 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1360/2726] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:20.303113 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1d54-190e-4bc6-9533-e7beb4db3024 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:20.309552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:20.313829 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1d54-190e-4bc6-9533-e7beb4db3024 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:20.320461 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e5ba9-5d38-4cd0-b549-47a1c5da2e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:20.321128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5ba9-5d38-4cd0-b549-47a1c5da2e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:20.321436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5ba9-5d38-4cd0-b549-47a1c5da2e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:20.321715 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5ba9-5d38-4cd0-b549-47a1c5da2e9a admin admin] PATH_INFO: `/v3/projects/33dc1ac693164ef092f36b243eeda89d/users/ce35ec050d6941ec94d9042e0eef286d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:20.340840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e5ba9-5d38-4cd0-b549-47a1c5da2e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dc1ac693164ef092f36b243eeda89d, user_id=ce35ec050d6941ec94d9042e0eef286d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:20.343568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e5ba9-5d38-4cd0-b549-47a1c5da2e9a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:20.358639 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1367/2727] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:20 2022] PUT /identity/v3/projects/33dc1ac693164ef092f36b243eeda89d/users/ce35ec050d6941ec94d9042e0eef286d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:35:20.362904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231dd39-aeb4-447d-bce1-e33934a6a52f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:20.373108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231dd39-aeb4-447d-bce1-e33934a6a52f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:20.387202 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:20.451429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abee83b-48fe-42f0-90cb-1de84b19e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:20.452061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abee83b-48fe-42f0-90cb-1de84b19e235 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:20.452337 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abee83b-48fe-42f0-90cb-1de84b19e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:20.452609 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abee83b-48fe-42f0-90cb-1de84b19e235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:20.453346 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abee83b-48fe-42f0-90cb-1de84b19e235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:20.454970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abee83b-48fe-42f0-90cb-1de84b19e235 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:20.466164 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1361/2728] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:20.470568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e5ba9-5d38-4cd0-b549-47a1c5da2e9a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:20.481486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e5ba9-5d38-4cd0-b549-47a1c5da2e9a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:20.486419 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713354-ff3c-424e-aa13-49a0d6cc403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:20.487091 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713354-ff3c-424e-aa13-49a0d6cc403d admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:20.487372 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713354-ff3c-424e-aa13-49a0d6cc403d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:20.487661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713354-ff3c-424e-aa13-49a0d6cc403d admin admin] PATH_INFO: `/v3/projects/33dc1ac693164ef092f36b243eeda89d/users/ce35ec050d6941ec94d9042e0eef286d/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:20.489782 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34713354-ff3c-424e-aa13-49a0d6cc403d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dc1ac693164ef092f36b243eeda89d, user_id=ce35ec050d6941ec94d9042e0eef286d, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:20.492429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34713354-ff3c-424e-aa13-49a0d6cc403d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:20.503433 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1368/2729] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:20 2022] PUT /identity/v3/projects/33dc1ac693164ef092f36b243eeda89d/users/ce35ec050d6941ec94d9042e0eef286d/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:20.514004 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0457254-ff91-4259-99c9-ea8adabf0c0b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:20.514286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0457254-ff91-4259-99c9-ea8adabf0c0b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:20.514557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0457254-ff91-4259-99c9-ea8adabf0c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:20.543648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e0457254-ff91-4259-99c9-ea8adabf0c0b None None] MFA Rules not processed for user `ce35ec050d6941ec94d9042e0eef286d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:20.544889 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e0457254-ff91-4259-99c9-ea8adabf0c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:20.622658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1362/2730] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:20.634600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713354-ff3c-424e-aa13-49a0d6cc403d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:20.637216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-34713354-ff3c-424e-aa13-49a0d6cc403d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:20.711571 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713354-ff3c-424e-aa13-49a0d6cc403d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:20.715695 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8282-497a-47d1-8b2a-aacfa7f36879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:20.716324 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8282-497a-47d1-8b2a-aacfa7f36879 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:20.716598 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8282-497a-47d1-8b2a-aacfa7f36879 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:20.716871 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8282-497a-47d1-8b2a-aacfa7f36879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:20.728662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8282-497a-47d1-8b2a-aacfa7f36879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:20.730621 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8282-497a-47d1-8b2a-aacfa7f36879 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:20.741311 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1369/2731] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:21.185862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0457254-ff91-4259-99c9-ea8adabf0c0b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:21.257100 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0457254-ff91-4259-99c9-ea8adabf0c0b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:21.261979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:21.262640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:21.262938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:21.263207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] PATH_INFO: `/v3/users/8d9c04db661d47ecb31fb9c602d2c442` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:21.264428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9c04db661d47ecb31fb9c602d2c442)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:21.266389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:21.321698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:21.331702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9c04db661d47ecb31fb9c602d2c442'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:21.343705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9c04db661d47ecb31fb9c602d2c442'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:21.360989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9c04db661d47ecb31fb9c602d2c442'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:21.369658 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9c04db661d47ecb31fb9c602d2c442'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:21.370504 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9c04db661d47ecb31fb9c602d2c442'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:21.376904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1363/2732] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:21 2022] DELETE /identity/v3/users/8d9c04db661d47ecb31fb9c602d2c442 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:35:21.382565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183291cc-340b-4f25-8cdc-9d2a92242dd8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:21.383012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183291cc-340b-4f25-8cdc-9d2a92242dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:21.383440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183291cc-340b-4f25-8cdc-9d2a92242dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:21.407586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-183291cc-340b-4f25-8cdc-9d2a92242dd8 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:21.408992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-183291cc-340b-4f25-8cdc-9d2a92242dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:21.479389 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1370/2733] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:21.491345 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:21.493062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:21.560016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb00d-b7d4-4978-a076-426bc3299000 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:21.564134 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fbb06-3cda-4cb9-b9c9-176622e54b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:21.564790 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbb06-3cda-4cb9-b9c9-176622e54b1c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:21.565061 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbb06-3cda-4cb9-b9c9-176622e54b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:21.565359 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbb06-3cda-4cb9-b9c9-176622e54b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:21.576610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fbb06-3cda-4cb9-b9c9-176622e54b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:21.578098 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fbb06-3cda-4cb9-b9c9-176622e54b1c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:21.589502 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1364/2734] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:21.648374 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3d691-7ccc-4e5a-830e-dc7e4df78b6b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:21.648643 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3d691-7ccc-4e5a-830e-dc7e4df78b6b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:21.648933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3d691-7ccc-4e5a-830e-dc7e4df78b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:21.671286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-abc3d691-7ccc-4e5a-830e-dc7e4df78b6b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:21.672539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-abc3d691-7ccc-4e5a-830e-dc7e4df78b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:21.681553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1371/2735] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:21.702740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fbb06-3cda-4cb9-b9c9-176622e54b1c service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:21.704399 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3d3fbb06-3cda-4cb9-b9c9-176622e54b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:21.814478 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fbb06-3cda-4cb9-b9c9-176622e54b1c service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:21.820553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d39b8a-72bc-47af-b8bf-c1785665fa96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:21.821188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d39b8a-72bc-47af-b8bf-c1785665fa96 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:21.821503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d39b8a-72bc-47af-b8bf-c1785665fa96 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:21.821778 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d39b8a-72bc-47af-b8bf-c1785665fa96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:21.830720 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d39b8a-72bc-47af-b8bf-c1785665fa96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:21.832325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d39b8a-72bc-47af-b8bf-c1785665fa96 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:21.842767 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1365/2736] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:21.908918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3d691-7ccc-4e5a-830e-dc7e4df78b6b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:21.910609 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-abc3d691-7ccc-4e5a-830e-dc7e4df78b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:21.923394 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3d691-7ccc-4e5a-830e-dc7e4df78b6b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:21.928936 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:21.929669 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:21.930047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:21.930201 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] PATH_INFO: `/v3/projects/00c55c4185c34e318e640db7a95f1794` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:21.931385 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c55c4185c34e318e640db7a95f1794)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:21.933444 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:21.997432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c55c4185c34e318e640db7a95f1794', 'request_id': 'req-f2089161-96b6-4c15-953f-201d8664a217'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.005406 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c55c4185c34e318e640db7a95f1794', 'request_id': 'req-f2089161-96b6-4c15-953f-201d8664a217'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.007527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:22.012093 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c55c4185c34e318e640db7a95f1794', 'request_id': 'req-f2089161-96b6-4c15-953f-201d8664a217'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.024778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] The token cache is being invalidate because project 00c55c4185c34e318e640db7a95f1794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:22.025068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.025733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.027283 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1372/2737] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:21 2022] DELETE /identity/v3/projects/00c55c4185c34e318e640db7a95f1794 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:22.031575 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d39b8a-72bc-47af-b8bf-c1785665fa96 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:22.041997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d39b8a-72bc-47af-b8bf-c1785665fa96 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:22.089596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:22.105294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:22.105993 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:22.106270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:22.106540 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] PATH_INFO: `/v3/users/ce35ec050d6941ec94d9042e0eef286d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:22.107709 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce35ec050d6941ec94d9042e0eef286d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:22.109681 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:22.161901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce35ec050d6941ec94d9042e0eef286d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.172926 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce35ec050d6941ec94d9042e0eef286d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.185959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce35ec050d6941ec94d9042e0eef286d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.192768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce35ec050d6941ec94d9042e0eef286d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.193462 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0249b293-2ed7-4729-b672-c7ebc7e2ab82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce35ec050d6941ec94d9042e0eef286d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.200062 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1366/2738] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:22 2022] DELETE /identity/v3/users/ce35ec050d6941ec94d9042e0eef286d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:22.504499 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:22.507587 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:22.543888 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2089161-96b6-4c15-953f-201d8664a217 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:22.609531 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:22.610186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:22.610458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:22.610728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] PATH_INFO: `/v3/projects/33dc1ac693164ef092f36b243eeda89d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:22.612029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33dc1ac693164ef092f36b243eeda89d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:22.613979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:22.663481 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33dc1ac693164ef092f36b243eeda89d', 'request_id': 'req-31d824a6-45e0-4e58-8387-e0b2ce07ed29'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.672228 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33dc1ac693164ef092f36b243eeda89d', 'request_id': 'req-31d824a6-45e0-4e58-8387-e0b2ce07ed29'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.680903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33dc1ac693164ef092f36b243eeda89d', 'request_id': 'req-31d824a6-45e0-4e58-8387-e0b2ce07ed29'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.693376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] The token cache is being invalidate because project 33dc1ac693164ef092f36b243eeda89d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:22.694030 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.694802 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-31d824a6-45e0-4e58-8387-e0b2ce07ed29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:22.696457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1373/2739] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:22 2022] DELETE /identity/v3/projects/33dc1ac693164ef092f36b243eeda89d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:22.701791 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee51253-c247-494f-b456-06d7d429a6aa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:22.702276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee51253-c247-494f-b456-06d7d429a6aa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:22.702384 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee51253-c247-494f-b456-06d7d429a6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:22.724316 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3ee51253-c247-494f-b456-06d7d429a6aa None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:22.726036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ee51253-c247-494f-b456-06d7d429a6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:22.790304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1367/2740] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:22.799569 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2270b-45fa-430e-8644-d03811f37e48 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:22.800769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2270b-45fa-430e-8644-d03811f37e48 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:22.801089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2270b-45fa-430e-8644-d03811f37e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:22.824901 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b8e2270b-45fa-430e-8644-d03811f37e48 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:22.826550 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b8e2270b-45fa-430e-8644-d03811f37e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:22.838711 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1374/2741] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:22.844253 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee51253-c247-494f-b456-06d7d429a6aa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:22.857060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee51253-c247-494f-b456-06d7d429a6aa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:22.862055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7704b-fade-40e9-9e0a-fd37cdcd6556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:22.862702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7704b-fade-40e9-9e0a-fd37cdcd6556 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:22.862977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7704b-fade-40e9-9e0a-fd37cdcd6556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:22.863248 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7704b-fade-40e9-9e0a-fd37cdcd6556 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:22.863963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7704b-fade-40e9-9e0a-fd37cdcd6556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:35:22.864265 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7704b-fade-40e9-9e0a-fd37cdcd6556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:22.865974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7704b-fade-40e9-9e0a-fd37cdcd6556 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:22.878900 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1368/2742] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:35:22.883604 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2270b-45fa-430e-8644-d03811f37e48 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:22.894089 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2270b-45fa-430e-8644-d03811f37e48 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:22.898840 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8b7be-ec66-4041-9b11-b8bcd2ded439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:22.899465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8b7be-ec66-4041-9b11-b8bcd2ded439 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:22.899739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8b7be-ec66-4041-9b11-b8bcd2ded439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:22.900012 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8b7be-ec66-4041-9b11-b8bcd2ded439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:22.900693 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8b7be-ec66-4041-9b11-b8bcd2ded439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:22.902673 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8b7be-ec66-4041-9b11-b8bcd2ded439 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:22.932341 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1375/2743] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:22 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:35:22.936481 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7704b-fade-40e9-9e0a-fd37cdcd6556 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:22.948780 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7704b-fade-40e9-9e0a-fd37cdcd6556 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:22.999546 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:23.010469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13658ce3-ecde-4785-a10d-fdb9180c7454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.011154 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13658ce3-ecde-4785-a10d-fdb9180c7454 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.011436 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13658ce3-ecde-4785-a10d-fdb9180c7454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.011719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13658ce3-ecde-4785-a10d-fdb9180c7454 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.012477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13658ce3-ecde-4785-a10d-fdb9180c7454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.014530 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13658ce3-ecde-4785-a10d-fdb9180c7454 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.037484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1369/2744] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:22 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:23.042370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8b7be-ec66-4041-9b11-b8bcd2ded439 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.053200 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8b7be-ec66-4041-9b11-b8bcd2ded439 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.058213 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673a54d-ba59-4699-8b9c-9b2d5abd2e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.058839 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673a54d-ba59-4699-8b9c-9b2d5abd2e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.059128 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673a54d-ba59-4699-8b9c-9b2d5abd2e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.059537 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673a54d-ba59-4699-8b9c-9b2d5abd2e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.060907 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673a54d-ba59-4699-8b9c-9b2d5abd2e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.063559 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673a54d-ba59-4699-8b9c-9b2d5abd2e18 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.075065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1376/2745] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:35:23.079492 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13658ce3-ecde-4785-a10d-fdb9180c7454 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.090049 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13658ce3-ecde-4785-a10d-fdb9180c7454 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.095293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76684446-f874-4c66-bf9a-33ee65fda4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.096173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76684446-f874-4c66-bf9a-33ee65fda4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.096512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76684446-f874-4c66-bf9a-33ee65fda4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.096811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76684446-f874-4c66-bf9a-33ee65fda4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.097802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76684446-f874-4c66-bf9a-33ee65fda4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.099498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76684446-f874-4c66-bf9a-33ee65fda4bc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.111752 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1370/2746] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:23.116377 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673a54d-ba59-4699-8b9c-9b2d5abd2e18 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.127480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673a54d-ba59-4699-8b9c-9b2d5abd2e18 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.132230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493a55-e31b-4886-9221-3c9406a535a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.132903 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493a55-e31b-4886-9221-3c9406a535a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.133184 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493a55-e31b-4886-9221-3c9406a535a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.133506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493a55-e31b-4886-9221-3c9406a535a8 admin admin] PATH_INFO: `/v3/projects/91a39d20ee644fd4a716171c9acf8b32/users/6c5303223d6940b2abe513c66a22c37e/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.148815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f493a55-e31b-4886-9221-3c9406a535a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a39d20ee644fd4a716171c9acf8b32, user_id=6c5303223d6940b2abe513c66a22c37e, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.151599 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f493a55-e31b-4886-9221-3c9406a535a8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.167102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1377/2747] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:23 2022] PUT /identity/v3/projects/91a39d20ee644fd4a716171c9acf8b32/users/6c5303223d6940b2abe513c66a22c37e/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:23.179238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640766b-10ed-4cc6-a7f2-594260331c7a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.179527 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640766b-10ed-4cc6-a7f2-594260331c7a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.179802 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640766b-10ed-4cc6-a7f2-594260331c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.212396 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2640766b-10ed-4cc6-a7f2-594260331c7a None None] MFA Rules not processed for user `6c5303223d6940b2abe513c66a22c37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:23.213735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2640766b-10ed-4cc6-a7f2-594260331c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:23.285701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1371/2748] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:23.289995 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493a55-e31b-4886-9221-3c9406a535a8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.305918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:23.360644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493a55-e31b-4886-9221-3c9406a535a8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.365605 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a005e-6e67-49c8-b656-c1b8ad4e1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.366241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a005e-6e67-49c8-b656-c1b8ad4e1434 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.366538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a005e-6e67-49c8-b656-c1b8ad4e1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.366791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a005e-6e67-49c8-b656-c1b8ad4e1434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.367524 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a005e-6e67-49c8-b656-c1b8ad4e1434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.369405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a005e-6e67-49c8-b656-c1b8ad4e1434 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.397796 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1378/2749] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:23 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:23.402066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640766b-10ed-4cc6-a7f2-594260331c7a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.414373 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640766b-10ed-4cc6-a7f2-594260331c7a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.486543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22551c-f58d-47b2-9ef5-6982e684d2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.487186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22551c-f58d-47b2-9ef5-6982e684d2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.487463 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22551c-f58d-47b2-9ef5-6982e684d2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.487768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22551c-f58d-47b2-9ef5-6982e684d2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.488476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22551c-f58d-47b2-9ef5-6982e684d2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.490433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22551c-f58d-47b2-9ef5-6982e684d2f8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.519537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1372/2750] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:23 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:23.524081 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a005e-6e67-49c8-b656-c1b8ad4e1434 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.537895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a005e-6e67-49c8-b656-c1b8ad4e1434 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.544705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ff9cb-71e3-4b92-b915-68aa2af8339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.545400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ff9cb-71e3-4b92-b915-68aa2af8339e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.545687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ff9cb-71e3-4b92-b915-68aa2af8339e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.545961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ff9cb-71e3-4b92-b915-68aa2af8339e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.546685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ff9cb-71e3-4b92-b915-68aa2af8339e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.548346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ff9cb-71e3-4b92-b915-68aa2af8339e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.560312 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1379/2751] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:35:23.565074 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22551c-f58d-47b2-9ef5-6982e684d2f8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.576750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22551c-f58d-47b2-9ef5-6982e684d2f8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.582695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1712e-621e-46ce-89f7-24b20efb7371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.583858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1712e-621e-46ce-89f7-24b20efb7371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.584402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1712e-621e-46ce-89f7-24b20efb7371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.584876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1712e-621e-46ce-89f7-24b20efb7371 admin admin] PATH_INFO: `/v3/projects/6360aa8254c947129c2e483cce1e8dd0/users/acdc43eb21ff4ebea921dbb185a76ba5/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.602921 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1712e-621e-46ce-89f7-24b20efb7371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6360aa8254c947129c2e483cce1e8dd0, user_id=acdc43eb21ff4ebea921dbb185a76ba5, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.605744 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1712e-621e-46ce-89f7-24b20efb7371 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.622525 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1373/2752] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:23 2022] PUT /identity/v3/projects/6360aa8254c947129c2e483cce1e8dd0/users/acdc43eb21ff4ebea921dbb185a76ba5/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:23.628592 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ff9cb-71e3-4b92-b915-68aa2af8339e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.640527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ff9cb-71e3-4b92-b915-68aa2af8339e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.707834 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5d4ad-35b9-41bc-8157-36662962833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.708487 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5d4ad-35b9-41bc-8157-36662962833e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.708773 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5d4ad-35b9-41bc-8157-36662962833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.709045 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5d4ad-35b9-41bc-8157-36662962833e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.709826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5d4ad-35b9-41bc-8157-36662962833e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.711482 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5d4ad-35b9-41bc-8157-36662962833e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.722757 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1380/2753] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:23.727328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1712e-621e-46ce-89f7-24b20efb7371 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.739645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1712e-621e-46ce-89f7-24b20efb7371 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.744626 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f62d68-87d5-4d73-a2fd-d95764c4c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.745389 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f62d68-87d5-4d73-a2fd-d95764c4c0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.745666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f62d68-87d5-4d73-a2fd-d95764c4c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.745940 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f62d68-87d5-4d73-a2fd-d95764c4c0e3 admin admin] PATH_INFO: `/v3/projects/6360aa8254c947129c2e483cce1e8dd0/users/acdc43eb21ff4ebea921dbb185a76ba5/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.748995 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f62d68-87d5-4d73-a2fd-d95764c4c0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6360aa8254c947129c2e483cce1e8dd0, user_id=acdc43eb21ff4ebea921dbb185a76ba5, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:23.752951 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f62d68-87d5-4d73-a2fd-d95764c4c0e3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:23.767124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1374/2754] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:23 2022] PUT /identity/v3/projects/6360aa8254c947129c2e483cce1e8dd0/users/acdc43eb21ff4ebea921dbb185a76ba5/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:23.777660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e312d24-b7fc-46ad-a526-4d50bc8bc8b1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.777948 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e312d24-b7fc-46ad-a526-4d50bc8bc8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.778226 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e312d24-b7fc-46ad-a526-4d50bc8bc8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:23.808122 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3e312d24-b7fc-46ad-a526-4d50bc8bc8b1 None None] MFA Rules not processed for user `acdc43eb21ff4ebea921dbb185a76ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:23.809410 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3e312d24-b7fc-46ad-a526-4d50bc8bc8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:23.893159 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1381/2755] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:23.910230 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f62d68-87d5-4d73-a2fd-d95764c4c0e3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:23.912119 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-90f62d68-87d5-4d73-a2fd-d95764c4c0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:23.928169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:23.986472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f62d68-87d5-4d73-a2fd-d95764c4c0e3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:23.991467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa146b-517a-4743-bd38-57e759fef84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:23.992055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa146b-517a-4743-bd38-57e759fef84d service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:23.992326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa146b-517a-4743-bd38-57e759fef84d service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:23.992596 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa146b-517a-4743-bd38-57e759fef84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:24.003663 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa146b-517a-4743-bd38-57e759fef84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:24.005290 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa146b-517a-4743-bd38-57e759fef84d service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:24.017751 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1375/2756] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:24.377498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e312d24-b7fc-46ad-a526-4d50bc8bc8b1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:24.389326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e312d24-b7fc-46ad-a526-4d50bc8bc8b1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:24.395728 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccf1f3-b27b-4c89-900c-8ad391f2da6f tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdc43eb21ff4ebea921dbb185a76ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360aa8254c947129c2e483cce1e8dd0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:24.396345 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf1f3-b27b-4c89-900c-8ad391f2da6f tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:24.396634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf1f3-b27b-4c89-900c-8ad391f2da6f tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:24.397011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf1f3-b27b-4c89-900c-8ad391f2da6f tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:24.397615 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccf1f3-b27b-4c89-900c-8ad391f2da6f tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:35:24.397932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccf1f3-b27b-4c89-900c-8ad391f2da6f tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:24.399586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccf1f3-b27b-4c89-900c-8ad391f2da6f tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:24.402502 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:24.413362 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1382/2757] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:35:24.418257 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa146b-517a-4743-bd38-57e759fef84d service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:24.428009 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa146b-517a-4743-bd38-57e759fef84d service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:24.433830 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3692793-cfed-49b7-bc87-8cee361e1bce tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdc43eb21ff4ebea921dbb185a76ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360aa8254c947129c2e483cce1e8dd0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:24.434455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3692793-cfed-49b7-bc87-8cee361e1bce tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:24.434741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3692793-cfed-49b7-bc87-8cee361e1bce tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:24.435014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3692793-cfed-49b7-bc87-8cee361e1bce tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:24.435838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3692793-cfed-49b7-bc87-8cee361e1bce tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:24.437959 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3692793-cfed-49b7-bc87-8cee361e1bce tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:24.470117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1376/2758] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:24 2022] POST /identity/v3/projects => generated 353 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:24.474519 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccf1f3-b27b-4c89-900c-8ad391f2da6f tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:24.485349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccf1f3-b27b-4c89-900c-8ad391f2da6f tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:24.553743 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4b54-3685-4b40-8e6e-7572055fa31b tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdc43eb21ff4ebea921dbb185a76ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360aa8254c947129c2e483cce1e8dd0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:24.554961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4b54-3685-4b40-8e6e-7572055fa31b tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:24.555298 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4b54-3685-4b40-8e6e-7572055fa31b tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:24.555876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4b54-3685-4b40-8e6e-7572055fa31b tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:24.557245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d4b54-3685-4b40-8e6e-7572055fa31b tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:35:24.557974 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d4b54-3685-4b40-8e6e-7572055fa31b tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:24.560987 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d4b54-3685-4b40-8e6e-7572055fa31b tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:24.582082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1383/2759] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:35:24.621495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3692793-cfed-49b7-bc87-8cee361e1bce tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:24.632738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3692793-cfed-49b7-bc87-8cee361e1bce tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:24.641349 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdc43eb21ff4ebea921dbb185a76ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360aa8254c947129c2e483cce1e8dd0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:24.642185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:24.642471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:24.642766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] PATH_INFO: `/v3/projects/da6a39d597df4d4e8f18cb105b8cc9d4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:24.644043 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da6a39d597df4d4e8f18cb105b8cc9d4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:24.646029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:24.716821 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6a39d597df4d4e8f18cb105b8cc9d4', 'request_id': 'req-0590a8aa-bddb-4153-9bea-6a40e8aae47c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:24.729348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6a39d597df4d4e8f18cb105b8cc9d4', 'request_id': 'req-0590a8aa-bddb-4153-9bea-6a40e8aae47c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:24.739679 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6a39d597df4d4e8f18cb105b8cc9d4', 'request_id': 'req-0590a8aa-bddb-4153-9bea-6a40e8aae47c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:24.754136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] The token cache is being invalidate because project da6a39d597df4d4e8f18cb105b8cc9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:24.754514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:24.755291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:24.760641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1377/2760] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:24 2022] DELETE /identity/v3/projects/da6a39d597df4d4e8f18cb105b8cc9d4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:24.929037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35958cba-2361-409c-974f-416ff311bc21 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:24.929951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35958cba-2361-409c-974f-416ff311bc21 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:24.930290 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35958cba-2361-409c-974f-416ff311bc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:24.952437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-35958cba-2361-409c-974f-416ff311bc21 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:24.953732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-35958cba-2361-409c-974f-416ff311bc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:24.967710 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:24.969294 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:25.035909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1384/2761] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:25.051795 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590a8aa-bddb-4153-9bea-6a40e8aae47c tempest-VolumeQuotaClassesTest-1319649229 tempest-VolumeQuotaClassesTest-1319649229-project-admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:25.058890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35958cba-2361-409c-974f-416ff311bc21 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:25.059773 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:25.060476 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-35958cba-2361-409c-974f-416ff311bc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:25.060607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:25.061016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:25.061383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] PATH_INFO: `/v3/users/6c5303223d6940b2abe513c66a22c37e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:25.062831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5303223d6940b2abe513c66a22c37e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:25.065021 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:25.089705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:25.127103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5303223d6940b2abe513c66a22c37e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.135853 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5303223d6940b2abe513c66a22c37e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.149890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5303223d6940b2abe513c66a22c37e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.159432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35958cba-2361-409c-974f-416ff311bc21 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:25.160479 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5303223d6940b2abe513c66a22c37e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.161382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-438e45e3-72de-4f8a-b75f-6427c7f50cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5303223d6940b2abe513c66a22c37e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.167328 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:25.168013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1378/2762] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:24 2022] DELETE /identity/v3/users/6c5303223d6940b2abe513c66a22c37e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:35:25.168221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:25.168614 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:25.169075 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:25.171992 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:25.174279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf2972-1441-4c19-8267-350a98b4b2f0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:25.174559 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf2972-1441-4c19-8267-350a98b4b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:25.174828 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf2972-1441-4c19-8267-350a98b4b2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:25.185785 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:25.187414 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:25.197998 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-36cf2972-1441-4c19-8267-350a98b4b2f0 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:25.198503 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1385/2763] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:35:25.199429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-36cf2972-1441-4c19-8267-350a98b4b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:25.271692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1379/2764] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:35:25.282748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:25.284931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:25.307137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:25.350402 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8ed85-c79a-4f95-abd5-71dd5b462ae6 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:25.402809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de948396-03dd-461b-8cf1-3b2bf2f3e02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:25.403347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de948396-03dd-461b-8cf1-3b2bf2f3e02e service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:25.403626 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de948396-03dd-461b-8cf1-3b2bf2f3e02e service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:25.403895 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de948396-03dd-461b-8cf1-3b2bf2f3e02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:25.416060 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de948396-03dd-461b-8cf1-3b2bf2f3e02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:25.417636 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de948396-03dd-461b-8cf1-3b2bf2f3e02e service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:25.428470 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1386/2765] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:25.719295 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf2972-1441-4c19-8267-350a98b4b2f0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:25.720789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-36cf2972-1441-4c19-8267-350a98b4b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:25.733947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf2972-1441-4c19-8267-350a98b4b2f0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:25.739572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:25.740455 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:25.740736 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:25.741008 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] PATH_INFO: `/v3/projects/91a39d20ee644fd4a716171c9acf8b32` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:25.742307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a39d20ee644fd4a716171c9acf8b32)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:25.744258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:25.803031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a39d20ee644fd4a716171c9acf8b32', 'request_id': 'req-73a3e808-930a-422c-8483-24e169c025ad'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.815117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a39d20ee644fd4a716171c9acf8b32', 'request_id': 'req-73a3e808-930a-422c-8483-24e169c025ad'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.826946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a39d20ee644fd4a716171c9acf8b32', 'request_id': 'req-73a3e808-930a-422c-8483-24e169c025ad'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.848850 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] The token cache is being invalidate because project 91a39d20ee644fd4a716171c9acf8b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:25.849419 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.850542 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:25.853003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1380/2766] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:25 2022] DELETE /identity/v3/projects/91a39d20ee644fd4a716171c9acf8b32 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:35:25.859970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de948396-03dd-461b-8cf1-3b2bf2f3e02e service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:25.877032 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de948396-03dd-461b-8cf1-3b2bf2f3e02e service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:25.957649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:25.958319 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:25.958602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:25.958879 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] PATH_INFO: `/v3/users/acdc43eb21ff4ebea921dbb185a76ba5` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:25.960157 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdc43eb21ff4ebea921dbb185a76ba5)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:25.962160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:26.023098 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdc43eb21ff4ebea921dbb185a76ba5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.023996 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdc43eb21ff4ebea921dbb185a76ba5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.024966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdc43eb21ff4ebea921dbb185a76ba5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.040438 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdc43eb21ff4ebea921dbb185a76ba5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.048007 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b0fb8eb-ca39-4dab-afe5-715523953054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdc43eb21ff4ebea921dbb185a76ba5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.052914 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:26.062497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1387/2767] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:25 2022] DELETE /identity/v3/users/acdc43eb21ff4ebea921dbb185a76ba5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:26.381358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:26.382882 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:26.397627 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e808-930a-422c-8483-24e169c025ad admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:26.419207 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:26.466883 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:26.467553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:26.467836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:26.468108 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] PATH_INFO: `/v3/projects/6360aa8254c947129c2e483cce1e8dd0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:26.469289 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6360aa8254c947129c2e483cce1e8dd0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:26.471214 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:26.521630 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6360aa8254c947129c2e483cce1e8dd0', 'request_id': 'req-62771554-14bf-4b63-9015-d7106393d29a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.531523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6360aa8254c947129c2e483cce1e8dd0', 'request_id': 'req-62771554-14bf-4b63-9015-d7106393d29a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.537826 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6360aa8254c947129c2e483cce1e8dd0', 'request_id': 'req-62771554-14bf-4b63-9015-d7106393d29a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.550231 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] The token cache is being invalidate because project 6360aa8254c947129c2e483cce1e8dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:26.550478 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.551315 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-62771554-14bf-4b63-9015-d7106393d29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:26.552892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1381/2768] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:26 2022] DELETE /identity/v3/projects/6360aa8254c947129c2e483cce1e8dd0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:26.558054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae45991-fe6a-443c-96cc-514c0979a7fa None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:26.558343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae45991-fe6a-443c-96cc-514c0979a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:26.558623 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae45991-fe6a-443c-96cc-514c0979a7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:26.582052 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6ae45991-fe6a-443c-96cc-514c0979a7fa None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:26.583306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6ae45991-fe6a-443c-96cc-514c0979a7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:26.675890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1388/2769] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:26.684768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc40ac-2022-46cb-946f-1f9f29a06672 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:26.684768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc40ac-2022-46cb-946f-1f9f29a06672 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:26.684768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc40ac-2022-46cb-946f-1f9f29a06672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:26.705888 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b0dc40ac-2022-46cb-946f-1f9f29a06672 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:26.707153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b0dc40ac-2022-46cb-946f-1f9f29a06672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:26.715801 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1382/2770] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:26.720221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae45991-fe6a-443c-96cc-514c0979a7fa None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:26.735905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae45991-fe6a-443c-96cc-514c0979a7fa None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:26.742507 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118604b-7b84-43d6-9394-98deff3c31d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:26.743147 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118604b-7b84-43d6-9394-98deff3c31d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:26.743424 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118604b-7b84-43d6-9394-98deff3c31d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:26.743690 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118604b-7b84-43d6-9394-98deff3c31d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:26.744400 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118604b-7b84-43d6-9394-98deff3c31d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:35:26.744705 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118604b-7b84-43d6-9394-98deff3c31d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:26.746401 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118604b-7b84-43d6-9394-98deff3c31d5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:26.759778 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1389/2771] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:35:26.764634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc40ac-2022-46cb-946f-1f9f29a06672 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:26.775072 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc40ac-2022-46cb-946f-1f9f29a06672 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:26.780929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bdbde-5d0d-433a-9db6-31c8f0b66db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:26.781600 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bdbde-5d0d-433a-9db6-31c8f0b66db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:26.781868 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bdbde-5d0d-433a-9db6-31c8f0b66db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:26.782142 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bdbde-5d0d-433a-9db6-31c8f0b66db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:26.782866 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bdbde-5d0d-433a-9db6-31c8f0b66db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:26.784855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bdbde-5d0d-433a-9db6-31c8f0b66db4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:26.819328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1383/2772] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:26 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:26.823961 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118604b-7b84-43d6-9394-98deff3c31d5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:26.838586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118604b-7b84-43d6-9394-98deff3c31d5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:26.932815 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835404f-2d1e-4b0a-a925-36b64386cf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:26.933647 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835404f-2d1e-4b0a-a925-36b64386cf9d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:26.933806 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835404f-2d1e-4b0a-a925-36b64386cf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:26.934019 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835404f-2d1e-4b0a-a925-36b64386cf9d admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:26.934989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835404f-2d1e-4b0a-a925-36b64386cf9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:26.936684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835404f-2d1e-4b0a-a925-36b64386cf9d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:26.961539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1390/2773] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:26 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:26.966046 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bdbde-5d0d-433a-9db6-31c8f0b66db4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:26.976557 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bdbde-5d0d-433a-9db6-31c8f0b66db4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:26.981224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9cf2e-d9d1-416e-8a0b-f8431bea42ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:26.981886 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cf2e-d9d1-416e-8a0b-f8431bea42ff admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:26.982159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cf2e-d9d1-416e-8a0b-f8431bea42ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:26.982428 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cf2e-d9d1-416e-8a0b-f8431bea42ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:26.983219 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9cf2e-d9d1-416e-8a0b-f8431bea42ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:26.984727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9cf2e-d9d1-416e-8a0b-f8431bea42ff admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:26.995060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1384/2774] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:26.999367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835404f-2d1e-4b0a-a925-36b64386cf9d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:27.010343 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835404f-2d1e-4b0a-a925-36b64386cf9d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:27.016309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027fde5-f0cd-40a4-95a2-b5f52b26a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:27.016808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027fde5-f0cd-40a4-95a2-b5f52b26a9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.017214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027fde5-f0cd-40a4-95a2-b5f52b26a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.017407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027fde5-f0cd-40a4-95a2-b5f52b26a9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.018121 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027fde5-f0cd-40a4-95a2-b5f52b26a9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:27.019761 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027fde5-f0cd-40a4-95a2-b5f52b26a9b4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:27.034694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1391/2775] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:35:27.039104 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9cf2e-d9d1-416e-8a0b-f8431bea42ff admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:27.050355 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9cf2e-d9d1-416e-8a0b-f8431bea42ff admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:27.055798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336dc5e-209c-4caf-a1e4-f97c26aedb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:27.056701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336dc5e-209c-4caf-a1e4-f97c26aedb51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.057035 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336dc5e-209c-4caf-a1e4-f97c26aedb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.057422 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336dc5e-209c-4caf-a1e4-f97c26aedb51 admin admin] PATH_INFO: `/v3/projects/53733d1b495348e6ab947b4000ad329d/users/bb40a555ee9c4cd8849676c65f170c85/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.074798 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336dc5e-209c-4caf-a1e4-f97c26aedb51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53733d1b495348e6ab947b4000ad329d, user_id=bb40a555ee9c4cd8849676c65f170c85, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:27.077562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336dc5e-209c-4caf-a1e4-f97c26aedb51 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:27.092741 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1385/2776] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:27 2022] PUT /identity/v3/projects/53733d1b495348e6ab947b4000ad329d/users/bb40a555ee9c4cd8849676c65f170c85/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:27.104520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035606-fa6e-476b-8356-cb72e9e4cd80 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.104777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035606-fa6e-476b-8356-cb72e9e4cd80 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.105054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035606-fa6e-476b-8356-cb72e9e4cd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.136133 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0b035606-fa6e-476b-8356-cb72e9e4cd80 None None] MFA Rules not processed for user `bb40a555ee9c4cd8849676c65f170c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:27.137436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0b035606-fa6e-476b-8356-cb72e9e4cd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:27.188866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:27.208955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1392/2777] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:27.214028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336dc5e-209c-4caf-a1e4-f97c26aedb51 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:27.268013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:27.284156 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336dc5e-209c-4caf-a1e4-f97c26aedb51 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:27.290661 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02520d-d6b5-40a6-a83e-afd1391fcc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:27.291224 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02520d-d6b5-40a6-a83e-afd1391fcc79 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.291506 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02520d-d6b5-40a6-a83e-afd1391fcc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.291827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02520d-d6b5-40a6-a83e-afd1391fcc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.292606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02520d-d6b5-40a6-a83e-afd1391fcc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:27.294566 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02520d-d6b5-40a6-a83e-afd1391fcc79 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:27.326934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1386/2778] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:27 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:27.331250 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b035606-fa6e-476b-8356-cb72e9e4cd80 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:27.342076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b035606-fa6e-476b-8356-cb72e9e4cd80 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:27.418158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b775ab-54de-4794-b9cd-ed02095aa5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:27.418729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b775ab-54de-4794-b9cd-ed02095aa5be admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.419010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b775ab-54de-4794-b9cd-ed02095aa5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.419337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b775ab-54de-4794-b9cd-ed02095aa5be admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.420188 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b775ab-54de-4794-b9cd-ed02095aa5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:27.422182 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b775ab-54de-4794-b9cd-ed02095aa5be admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:27.444955 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1393/2779] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:27 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:27.449131 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02520d-d6b5-40a6-a83e-afd1391fcc79 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:27.467362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02520d-d6b5-40a6-a83e-afd1391fcc79 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:27.473491 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e80bf-6715-4fcd-9f6c-0aa4c64a9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:27.474203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e80bf-6715-4fcd-9f6c-0aa4c64a9074 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.474495 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e80bf-6715-4fcd-9f6c-0aa4c64a9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.474787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e80bf-6715-4fcd-9f6c-0aa4c64a9074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.475581 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e80bf-6715-4fcd-9f6c-0aa4c64a9074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:27.477235 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e80bf-6715-4fcd-9f6c-0aa4c64a9074 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:27.490287 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1387/2780] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:27.495153 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b775ab-54de-4794-b9cd-ed02095aa5be admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:27.506382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b775ab-54de-4794-b9cd-ed02095aa5be admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:27.511637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c4b9-c75b-4954-9369-bbfb00d635d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:27.512348 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c4b9-c75b-4954-9369-bbfb00d635d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.512628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c4b9-c75b-4954-9369-bbfb00d635d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.512909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c4b9-c75b-4954-9369-bbfb00d635d4 admin admin] PATH_INFO: `/v3/projects/b02268b10feb4012bc62d1e6f691771c/users/69f7b8d674d6461a9c1cf9aea2a4c422/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.530426 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c4b9-c75b-4954-9369-bbfb00d635d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02268b10feb4012bc62d1e6f691771c, user_id=69f7b8d674d6461a9c1cf9aea2a4c422, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:27.533309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c4b9-c75b-4954-9369-bbfb00d635d4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:27.549994 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1394/2781] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:27 2022] PUT /identity/v3/projects/b02268b10feb4012bc62d1e6f691771c/users/69f7b8d674d6461a9c1cf9aea2a4c422/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:27.554336 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e80bf-6715-4fcd-9f6c-0aa4c64a9074 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:27.566055 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e80bf-6715-4fcd-9f6c-0aa4c64a9074 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:27.629031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a4573-3d73-4378-9dc4-f90863fd6e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:27.629701 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a4573-3d73-4378-9dc4-f90863fd6e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.629977 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a4573-3d73-4378-9dc4-f90863fd6e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.630244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a4573-3d73-4378-9dc4-f90863fd6e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.630988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a4573-3d73-4378-9dc4-f90863fd6e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:27.632654 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a4573-3d73-4378-9dc4-f90863fd6e40 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:27.644647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1388/2782] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:27.649305 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c4b9-c75b-4954-9369-bbfb00d635d4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:27.660472 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c4b9-c75b-4954-9369-bbfb00d635d4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:27.665648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b17114-99c0-4ce5-b512-fda899c4a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:27.666349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b17114-99c0-4ce5-b512-fda899c4a338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.666650 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b17114-99c0-4ce5-b512-fda899c4a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.666906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b17114-99c0-4ce5-b512-fda899c4a338 admin admin] PATH_INFO: `/v3/projects/b02268b10feb4012bc62d1e6f691771c/users/69f7b8d674d6461a9c1cf9aea2a4c422/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.668964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b17114-99c0-4ce5-b512-fda899c4a338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02268b10feb4012bc62d1e6f691771c, user_id=69f7b8d674d6461a9c1cf9aea2a4c422, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:27.671678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b17114-99c0-4ce5-b512-fda899c4a338 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:27.683240 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1395/2783] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:27 2022] PUT /identity/v3/projects/b02268b10feb4012bc62d1e6f691771c/users/69f7b8d674d6461a9c1cf9aea2a4c422/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:27.694494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f769ba8-f369-4e7a-a645-8d8bd3e27fd3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.694840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f769ba8-f369-4e7a-a645-8d8bd3e27fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.695249 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f769ba8-f369-4e7a-a645-8d8bd3e27fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.726432 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3f769ba8-f369-4e7a-a645-8d8bd3e27fd3 None None] MFA Rules not processed for user `69f7b8d674d6461a9c1cf9aea2a4c422`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:27.727688 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3f769ba8-f369-4e7a-a645-8d8bd3e27fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:27.800171 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1389/2784] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:27.811516 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b17114-99c0-4ce5-b512-fda899c4a338 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:27.813436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-57b17114-99c0-4ce5-b512-fda899c4a338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:27.879220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b17114-99c0-4ce5-b512-fda899c4a338 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:27.884465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740fee6-e2f0-4ac7-8473-67bcfbd9de68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:27.885231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740fee6-e2f0-4ac7-8473-67bcfbd9de68 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:27.885525 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740fee6-e2f0-4ac7-8473-67bcfbd9de68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:27.885836 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740fee6-e2f0-4ac7-8473-67bcfbd9de68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:27.896517 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740fee6-e2f0-4ac7-8473-67bcfbd9de68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:27.898299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740fee6-e2f0-4ac7-8473-67bcfbd9de68 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:27.909282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1396/2785] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:28.000671 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08983a3-b209-4e81-90a8-970c57b96a2a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:28.001081 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08983a3-b209-4e81-90a8-970c57b96a2a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:28.001572 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08983a3-b209-4e81-90a8-970c57b96a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:28.028057 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f08983a3-b209-4e81-90a8-970c57b96a2a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:28.029320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f08983a3-b209-4e81-90a8-970c57b96a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:28.069286 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740fee6-e2f0-4ac7-8473-67bcfbd9de68 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:28.079234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:28.103204 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1390/2786] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:28.118610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:28.127213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08983a3-b209-4e81-90a8-970c57b96a2a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:28.128822 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f08983a3-b209-4e81-90a8-970c57b96a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:28.139909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740fee6-e2f0-4ac7-8473-67bcfbd9de68 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:28.146275 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:28.146931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:28.147208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:28.147477 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] PATH_INFO: `/v3/users/bb40a555ee9c4cd8849676c65f170c85` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:28.148716 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb40a555ee9c4cd8849676c65f170c85)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:28.150685 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:28.211930 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb40a555ee9c4cd8849676c65f170c85'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:28.212662 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb40a555ee9c4cd8849676c65f170c85'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:28.213763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb40a555ee9c4cd8849676c65f170c85'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:28.214451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08983a3-b209-4e81-90a8-970c57b96a2a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:28.221561 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:28.222203 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:28.222483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:28.222779 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:28.226111 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:28.230064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb40a555ee9c4cd8849676c65f170c85'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:28.239036 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b98cc99c-68f6-470d-84d7-cc73d50607d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb40a555ee9c4cd8849676c65f170c85'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:28.239299 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:28.240903 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:28.255230 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1397/2787] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:28 2022] DELETE /identity/v3/users/bb40a555ee9c4cd8849676c65f170c85 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:28.260275 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7a64-5969-42d7-96c2-ce81b2b74c64 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:28.260546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7a64-5969-42d7-96c2-ce81b2b74c64 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:28.261023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7a64-5969-42d7-96c2-ce81b2b74c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:28.264016 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1391/2788] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:35:28.282220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a4ec7a64-5969-42d7-96c2-ce81b2b74c64 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:28.283602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a4ec7a64-5969-42d7-96c2-ce81b2b74c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:28.380703 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1398/2789] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:28.393036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:28.394686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:28.474985 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190593cf-fbbe-4a24-b0a1-59f0d7b569c6 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:28.542234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5fa9-01f6-47f1-97e9-7dffff75f612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:28.542869 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5fa9-01f6-47f1-97e9-7dffff75f612 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:28.543178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5fa9-01f6-47f1-97e9-7dffff75f612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:28.543480 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5fa9-01f6-47f1-97e9-7dffff75f612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:28.554528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e5fa9-01f6-47f1-97e9-7dffff75f612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:28.556014 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e5fa9-01f6-47f1-97e9-7dffff75f612 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:28.567048 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1392/2790] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:28.969536 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7a64-5969-42d7-96c2-ce81b2b74c64 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:28.971464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a4ec7a64-5969-42d7-96c2-ce81b2b74c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:28.985054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7a64-5969-42d7-96c2-ce81b2b74c64 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:28.992297 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:28.993163 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:28.993570 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:28.993944 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] PATH_INFO: `/v3/projects/53733d1b495348e6ab947b4000ad329d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:28.995500 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53733d1b495348e6ab947b4000ad329d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:28.998527 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:29.063748 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53733d1b495348e6ab947b4000ad329d', 'request_id': 'req-326f66f7-403b-4ee2-aa98-027977e01ea7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.073847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53733d1b495348e6ab947b4000ad329d', 'request_id': 'req-326f66f7-403b-4ee2-aa98-027977e01ea7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.077447 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:29.085494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53733d1b495348e6ab947b4000ad329d', 'request_id': 'req-326f66f7-403b-4ee2-aa98-027977e01ea7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.106405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] The token cache is being invalidate because project 53733d1b495348e6ab947b4000ad329d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:29.106698 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.107564 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.109407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1399/2791] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:28 2022] DELETE /identity/v3/projects/53733d1b495348e6ab947b4000ad329d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:29.114686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5fa9-01f6-47f1-97e9-7dffff75f612 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:29.134059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5fa9-01f6-47f1-97e9-7dffff75f612 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:29.181413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:29.210860 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:29.211631 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:29.211910 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:29.212183 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] PATH_INFO: `/v3/users/69f7b8d674d6461a9c1cf9aea2a4c422` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:29.213608 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f7b8d674d6461a9c1cf9aea2a4c422)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:29.215597 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:29.285979 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f7b8d674d6461a9c1cf9aea2a4c422'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.300215 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f7b8d674d6461a9c1cf9aea2a4c422'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.313974 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f7b8d674d6461a9c1cf9aea2a4c422'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.329497 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f7b8d674d6461a9c1cf9aea2a4c422'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.330395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eae7a4d5-8717-45de-ad96-7c5368f5b356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f7b8d674d6461a9c1cf9aea2a4c422'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:29.338103 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1393/2792] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:29 2022] DELETE /identity/v3/users/69f7b8d674d6461a9c1cf9aea2a4c422 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:29.722973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:29.727167 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:29.843460 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f66f7-403b-4ee2-aa98-027977e01ea7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:29.939257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:29.939965 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:29.940244 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:29.940578 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] PATH_INFO: `/v3/projects/b02268b10feb4012bc62d1e6f691771c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:29.942082 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02268b10feb4012bc62d1e6f691771c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:29.944435 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:30.013142 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02268b10feb4012bc62d1e6f691771c', 'request_id': 'req-62bc88ad-b032-47ea-9244-928080bad581'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:30.025880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02268b10feb4012bc62d1e6f691771c', 'request_id': 'req-62bc88ad-b032-47ea-9244-928080bad581'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:30.036054 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02268b10feb4012bc62d1e6f691771c', 'request_id': 'req-62bc88ad-b032-47ea-9244-928080bad581'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:30.051382 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] The token cache is being invalidate because project b02268b10feb4012bc62d1e6f691771c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:30.051679 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:30.052451 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62bc88ad-b032-47ea-9244-928080bad581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:30.054309 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1400/2793] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:29 2022] DELETE /identity/v3/projects/b02268b10feb4012bc62d1e6f691771c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:30.061069 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab8f36-1ef7-4ff5-86ab-c5436b509229 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.061625 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab8f36-1ef7-4ff5-86ab-c5436b509229 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.062088 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab8f36-1ef7-4ff5-86ab-c5436b509229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.163880 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f5ab8f36-1ef7-4ff5-86ab-c5436b509229 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:30.165193 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5ab8f36-1ef7-4ff5-86ab-c5436b509229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:30.257113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1394/2794] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:30.338786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277a4c-64a7-46d6-b322-86989f6f990b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.339513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277a4c-64a7-46d6-b322-86989f6f990b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.339513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277a4c-64a7-46d6-b322-86989f6f990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.363349 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9f277a4c-64a7-46d6-b322-86989f6f990b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:30.364586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f277a4c-64a7-46d6-b322-86989f6f990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:30.373376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1401/2795] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:30.382922 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab8f36-1ef7-4ff5-86ab-c5436b509229 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:30.395514 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab8f36-1ef7-4ff5-86ab-c5436b509229 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:30.401065 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8a780-be21-417f-b01b-53278e64cebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:30.401799 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a780-be21-417f-b01b-53278e64cebe admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.402112 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a780-be21-417f-b01b-53278e64cebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.402387 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a780-be21-417f-b01b-53278e64cebe admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.403149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8a780-be21-417f-b01b-53278e64cebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:35:30.403485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8a780-be21-417f-b01b-53278e64cebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:30.405138 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8a780-be21-417f-b01b-53278e64cebe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:30.418278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1395/2796] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:35:30.422971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277a4c-64a7-46d6-b322-86989f6f990b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:30.433783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277a4c-64a7-46d6-b322-86989f6f990b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:30.439291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3005-ddb5-4906-a160-d4df735d68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:30.439966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3005-ddb5-4906-a160-d4df735d68e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.440249 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3005-ddb5-4906-a160-d4df735d68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.440523 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3005-ddb5-4906-a160-d4df735d68e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.441392 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd3005-ddb5-4906-a160-d4df735d68e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:30.443920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd3005-ddb5-4906-a160-d4df735d68e1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:30.450704 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:30.478023 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1402/2797] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:30 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:30.482994 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8a780-be21-417f-b01b-53278e64cebe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:30.488683 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:30.495168 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8a780-be21-417f-b01b-53278e64cebe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:30.575763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748e993-674e-4946-b7fe-1bf6a529d174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:30.576669 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748e993-674e-4946-b7fe-1bf6a529d174 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.576958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748e993-674e-4946-b7fe-1bf6a529d174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.577304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748e993-674e-4946-b7fe-1bf6a529d174 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.578401 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748e993-674e-4946-b7fe-1bf6a529d174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:30.581440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748e993-674e-4946-b7fe-1bf6a529d174 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:30.617036 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1396/2798] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:30 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:30.621600 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3005-ddb5-4906-a160-d4df735d68e1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:30.632336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3005-ddb5-4906-a160-d4df735d68e1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:30.639034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc975-a888-4575-8e42-5b1b8d66c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:30.639686 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc975-a888-4575-8e42-5b1b8d66c404 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.639964 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc975-a888-4575-8e42-5b1b8d66c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.640234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc975-a888-4575-8e42-5b1b8d66c404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.640952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc975-a888-4575-8e42-5b1b8d66c404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:30.642750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc975-a888-4575-8e42-5b1b8d66c404 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:30.654136 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1403/2799] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:35:30.658513 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748e993-674e-4946-b7fe-1bf6a529d174 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:30.671123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748e993-674e-4946-b7fe-1bf6a529d174 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:30.676344 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08caf7e-e80c-4ab9-89bb-5d1e6b19f888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:30.676983 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08caf7e-e80c-4ab9-89bb-5d1e6b19f888 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.677286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08caf7e-e80c-4ab9-89bb-5d1e6b19f888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.677632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08caf7e-e80c-4ab9-89bb-5d1e6b19f888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.678276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08caf7e-e80c-4ab9-89bb-5d1e6b19f888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:30.679876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08caf7e-e80c-4ab9-89bb-5d1e6b19f888 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:30.694827 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1397/2800] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:30.700574 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc975-a888-4575-8e42-5b1b8d66c404 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:30.711596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc975-a888-4575-8e42-5b1b8d66c404 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:30.720975 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2da2de-5eba-4fad-b28c-fd9b5e0c5d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:30.723067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2da2de-5eba-4fad-b28c-fd9b5e0c5d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.723737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2da2de-5eba-4fad-b28c-fd9b5e0c5d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.724037 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2da2de-5eba-4fad-b28c-fd9b5e0c5d42 admin admin] PATH_INFO: `/v3/projects/7f098a6dd0c647299ab0e2acc7df06b2/users/dac3e629eb8c4af9bc6b9da1da3b3cc6/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.742866 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2da2de-5eba-4fad-b28c-fd9b5e0c5d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f098a6dd0c647299ab0e2acc7df06b2, user_id=dac3e629eb8c4af9bc6b9da1da3b3cc6, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:30.745821 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2da2de-5eba-4fad-b28c-fd9b5e0c5d42 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:30.760841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1404/2801] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:30 2022] PUT /identity/v3/projects/7f098a6dd0c647299ab0e2acc7df06b2/users/dac3e629eb8c4af9bc6b9da1da3b3cc6/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:30.774093 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05ad9-e9a3-42d0-be94-d9d6b34265f5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.774605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05ad9-e9a3-42d0-be94-d9d6b34265f5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.774713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05ad9-e9a3-42d0-be94-d9d6b34265f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.806769 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-87c05ad9-e9a3-42d0-be94-d9d6b34265f5 None None] MFA Rules not processed for user `dac3e629eb8c4af9bc6b9da1da3b3cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:30.808101 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-87c05ad9-e9a3-42d0-be94-d9d6b34265f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:30.878037 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1398/2802] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:30.882616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2da2de-5eba-4fad-b28c-fd9b5e0c5d42 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:30.952729 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2da2de-5eba-4fad-b28c-fd9b5e0c5d42 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:30.958497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08420c7a-a6b6-42da-8d2b-40bcd16c1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:30.959144 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08420c7a-a6b6-42da-8d2b-40bcd16c1720 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:30.959423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08420c7a-a6b6-42da-8d2b-40bcd16c1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:30.959742 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08420c7a-a6b6-42da-8d2b-40bcd16c1720 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:30.960465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08420c7a-a6b6-42da-8d2b-40bcd16c1720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:30.962454 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08420c7a-a6b6-42da-8d2b-40bcd16c1720 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:30.997289 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1405/2803] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:30 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:31.001667 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c05ad9-e9a3-42d0-be94-d9d6b34265f5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:31.013364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c05ad9-e9a3-42d0-be94-d9d6b34265f5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:31.096356 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee33b0-0943-4d09-803b-38470b0693b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:31.097523 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee33b0-0943-4d09-803b-38470b0693b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:31.097865 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee33b0-0943-4d09-803b-38470b0693b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:31.098139 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee33b0-0943-4d09-803b-38470b0693b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:31.098856 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee33b0-0943-4d09-803b-38470b0693b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:31.100855 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee33b0-0943-4d09-803b-38470b0693b9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:31.120774 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:31.128321 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1399/2804] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:31 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:35:31.132344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08420c7a-a6b6-42da-8d2b-40bcd16c1720 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:31.144102 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08420c7a-a6b6-42da-8d2b-40bcd16c1720 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:31.152203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02ab25-4ae4-47cb-b48c-a07179b1a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:31.152203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02ab25-4ae4-47cb-b48c-a07179b1a311 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:31.152203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02ab25-4ae4-47cb-b48c-a07179b1a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:31.152203 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02ab25-4ae4-47cb-b48c-a07179b1a311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:31.158284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02ab25-4ae4-47cb-b48c-a07179b1a311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:31.158284 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02ab25-4ae4-47cb-b48c-a07179b1a311 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:31.165719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1406/2805] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:31.174957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee33b0-0943-4d09-803b-38470b0693b9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:31.195969 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee33b0-0943-4d09-803b-38470b0693b9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:31.204673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d057e-9ebd-472e-acf7-1bd0c1ef13a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:31.204673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d057e-9ebd-472e-acf7-1bd0c1ef13a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:31.204673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d057e-9ebd-472e-acf7-1bd0c1ef13a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:31.204673 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d057e-9ebd-472e-acf7-1bd0c1ef13a5 admin admin] PATH_INFO: `/v3/projects/a585ba218e184ffc85fbd19b5e836cfc/users/74fdd1149e1740bd985d5a2e9ece0088/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:31.226056 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d057e-9ebd-472e-acf7-1bd0c1ef13a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a585ba218e184ffc85fbd19b5e836cfc, user_id=74fdd1149e1740bd985d5a2e9ece0088, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:31.228789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d057e-9ebd-472e-acf7-1bd0c1ef13a5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:31.244429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73c0c-fd3d-4fb2-a2bd-b1401b0a091e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:31.244875 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73c0c-fd3d-4fb2-a2bd-b1401b0a091e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:31.245387 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73c0c-fd3d-4fb2-a2bd-b1401b0a091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:31.246620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1400/2806] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:31 2022] PUT /identity/v3/projects/a585ba218e184ffc85fbd19b5e836cfc/users/74fdd1149e1740bd985d5a2e9ece0088/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:31.251824 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d057e-9ebd-472e-acf7-1bd0c1ef13a5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:31.287412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-13d73c0c-fd3d-4fb2-a2bd-b1401b0a091e None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:31.289526 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-13d73c0c-fd3d-4fb2-a2bd-b1401b0a091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:31.339191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d057e-9ebd-472e-acf7-1bd0c1ef13a5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:31.344477 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0fb94-894b-4bfe-be2c-2471e18ee511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:31.345147 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0fb94-894b-4bfe-be2c-2471e18ee511 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:31.345469 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0fb94-894b-4bfe-be2c-2471e18ee511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:31.345750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0fb94-894b-4bfe-be2c-2471e18ee511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:31.346471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0fb94-894b-4bfe-be2c-2471e18ee511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:31.348125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0fb94-894b-4bfe-be2c-2471e18ee511 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:31.369412 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1401/2807] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:35:31.370763 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0fb94-894b-4bfe-be2c-2471e18ee511 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:31.373933 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1407/2808] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:35:31.383735 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0fb94-894b-4bfe-be2c-2471e18ee511 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:31.388901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c64c1-5691-4c0d-9d75-5b2185d44a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:31.389636 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c64c1-5691-4c0d-9d75-5b2185d44a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:31.389920 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c64c1-5691-4c0d-9d75-5b2185d44a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:31.390512 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c64c1-5691-4c0d-9d75-5b2185d44a87 admin admin] PATH_INFO: `/v3/projects/a585ba218e184ffc85fbd19b5e836cfc/users/74fdd1149e1740bd985d5a2e9ece0088/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:31.392570 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c64c1-5691-4c0d-9d75-5b2185d44a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a585ba218e184ffc85fbd19b5e836cfc, user_id=74fdd1149e1740bd985d5a2e9ece0088, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:31.395325 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c64c1-5691-4c0d-9d75-5b2185d44a87 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:31.399777 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73c0c-fd3d-4fb2-a2bd-b1401b0a091e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:31.401515 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-13d73c0c-fd3d-4fb2-a2bd-b1401b0a091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:31.408033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1402/2809] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:31 2022] PUT /identity/v3/projects/a585ba218e184ffc85fbd19b5e836cfc/users/74fdd1149e1740bd985d5a2e9ece0088/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:35:31.419010 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629386-c14b-409c-8db3-7a55d771a25e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:31.419288 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629386-c14b-409c-8db3-7a55d771a25e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:31.419560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629386-c14b-409c-8db3-7a55d771a25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:31.442807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:31.455196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a4629386-c14b-409c-8db3-7a55d771a25e None None] MFA Rules not processed for user `74fdd1149e1740bd985d5a2e9ece0088`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:31.456476 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a4629386-c14b-409c-8db3-7a55d771a25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:31.537980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1403/2810] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:35:31.547465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73c0c-fd3d-4fb2-a2bd-b1401b0a091e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:31.550591 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629386-c14b-409c-8db3-7a55d771a25e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:31.552357 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a4629386-c14b-409c-8db3-7a55d771a25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:31.602825 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:31.616624 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629386-c14b-409c-8db3-7a55d771a25e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:31.620509 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f37c3-c41c-4efb-8fa7-6b5984ff88fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:31.621175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f37c3-c41c-4efb-8fa7-6b5984ff88fd service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:31.621483 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f37c3-c41c-4efb-8fa7-6b5984ff88fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:31.621702 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088de83-6bac-4d5e-8281-0956b5e02068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:31.621906 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f37c3-c41c-4efb-8fa7-6b5984ff88fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:31.622338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088de83-6bac-4d5e-8281-0956b5e02068 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:31.622616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088de83-6bac-4d5e-8281-0956b5e02068 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:31.622931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088de83-6bac-4d5e-8281-0956b5e02068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:31.633279 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f37c3-c41c-4efb-8fa7-6b5984ff88fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:31.636150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f37c3-c41c-4efb-8fa7-6b5984ff88fd service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:31.650831 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1404/2811] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:31.690560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088de83-6bac-4d5e-8281-0956b5e02068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:31.690560 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088de83-6bac-4d5e-8281-0956b5e02068 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:31.698798 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1408/2812] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:35:32.078840 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f37c3-c41c-4efb-8fa7-6b5984ff88fd service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:32.090413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f37c3-c41c-4efb-8fa7-6b5984ff88fd service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:32.095699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:32.096420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:32.096833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:32.097169 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] PATH_INFO: `/v3/users/dac3e629eb8c4af9bc6b9da1da3b3cc6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:32.098695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac3e629eb8c4af9bc6b9da1da3b3cc6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:32.100714 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:32.157558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac3e629eb8c4af9bc6b9da1da3b3cc6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.171641 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac3e629eb8c4af9bc6b9da1da3b3cc6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.186188 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac3e629eb8c4af9bc6b9da1da3b3cc6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.193281 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac3e629eb8c4af9bc6b9da1da3b3cc6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.194393 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac3e629eb8c4af9bc6b9da1da3b3cc6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.200884 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1405/2813] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:32 2022] DELETE /identity/v3/users/dac3e629eb8c4af9bc6b9da1da3b3cc6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:32.206139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ac30-36e3-416d-821c-bdada19c3189 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:32.206427 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ac30-36e3-416d-821c-bdada19c3189 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:32.206794 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ac30-36e3-416d-821c-bdada19c3189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:32.227644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5624ac30-36e3-416d-821c-bdada19c3189 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:32.228896 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5624ac30-36e3-416d-821c-bdada19c3189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:32.241678 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:32.344046 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1409/2814] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:32.355328 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:32.357282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:32.419894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc292-9524-4938-bddd-2fac10ccd128 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:32.424170 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fad8bd-2c76-4113-91ec-66c562bf6c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:32.424847 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fad8bd-2c76-4113-91ec-66c562bf6c72 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:32.425117 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fad8bd-2c76-4113-91ec-66c562bf6c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:32.425416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fad8bd-2c76-4113-91ec-66c562bf6c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:32.436256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fad8bd-2c76-4113-91ec-66c562bf6c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:32.437754 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fad8bd-2c76-4113-91ec-66c562bf6c72 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:32.448146 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1406/2815] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:32.746332 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624ac30-36e3-416d-821c-bdada19c3189 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:32.748586 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5624ac30-36e3-416d-821c-bdada19c3189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:32.761190 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624ac30-36e3-416d-821c-bdada19c3189 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:32.766180 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:32.766923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:32.767528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:32.768017 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] PATH_INFO: `/v3/projects/7f098a6dd0c647299ab0e2acc7df06b2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:32.769139 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f098a6dd0c647299ab0e2acc7df06b2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:32.771103 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:32.822838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f098a6dd0c647299ab0e2acc7df06b2', 'request_id': 'req-b46df834-2a0d-4d79-9fab-b691cc015f16'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.830825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f098a6dd0c647299ab0e2acc7df06b2', 'request_id': 'req-b46df834-2a0d-4d79-9fab-b691cc015f16'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.836395 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f098a6dd0c647299ab0e2acc7df06b2', 'request_id': 'req-b46df834-2a0d-4d79-9fab-b691cc015f16'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.847973 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] The token cache is being invalidate because project 7f098a6dd0c647299ab0e2acc7df06b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:32.848234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.848905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.850479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1410/2816] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:32 2022] DELETE /identity/v3/projects/7f098a6dd0c647299ab0e2acc7df06b2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:32.854555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fad8bd-2c76-4113-91ec-66c562bf6c72 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:32.864892 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fad8bd-2c76-4113-91ec-66c562bf6c72 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:32.926904 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:32.927549 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:32.927844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:32.928121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] PATH_INFO: `/v3/users/74fdd1149e1740bd985d5a2e9ece0088` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:32.929362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74fdd1149e1740bd985d5a2e9ece0088)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:32.931270 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:32.933811 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:32.980222 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74fdd1149e1740bd985d5a2e9ece0088'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:32.991685 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74fdd1149e1740bd985d5a2e9ece0088'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:33.010972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74fdd1149e1740bd985d5a2e9ece0088'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:33.017849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74fdd1149e1740bd985d5a2e9ece0088'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:33.018587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1c873991-b205-49e5-956f-c69fa0ffb198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74fdd1149e1740bd985d5a2e9ece0088'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:33.024460 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1407/2817] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:32 2022] DELETE /identity/v3/users/74fdd1149e1740bd985d5a2e9ece0088 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:33.305687 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:33.307155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:33.324304 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df834-2a0d-4d79-9fab-b691cc015f16 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:33.386379 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:33.387073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.387346 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.387616 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] PATH_INFO: `/v3/projects/a585ba218e184ffc85fbd19b5e836cfc` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.395565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a585ba218e184ffc85fbd19b5e836cfc)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:33.399282 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:33.464952 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:33.473429 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a585ba218e184ffc85fbd19b5e836cfc', 'request_id': 'req-ec483026-c2b2-4d63-957e-6630a189cb34'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:33.482246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a585ba218e184ffc85fbd19b5e836cfc', 'request_id': 'req-ec483026-c2b2-4d63-957e-6630a189cb34'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:33.489000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a585ba218e184ffc85fbd19b5e836cfc', 'request_id': 'req-ec483026-c2b2-4d63-957e-6630a189cb34'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:33.500480 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] The token cache is being invalidate because project a585ba218e184ffc85fbd19b5e836cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:33.500763 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:33.501446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec483026-c2b2-4d63-957e-6630a189cb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:33.502993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1411/2818] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:33 2022] DELETE /identity/v3/projects/a585ba218e184ffc85fbd19b5e836cfc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:33.508324 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc2cd3-8ae5-4623-9a14-67c414bfbe0d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.508817 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc2cd3-8ae5-4623-9a14-67c414bfbe0d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.508915 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc2cd3-8ae5-4623-9a14-67c414bfbe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.529622 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0acc2cd3-8ae5-4623-9a14-67c414bfbe0d None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:33.530842 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0acc2cd3-8ae5-4623-9a14-67c414bfbe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:33.593162 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1408/2819] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:33.601366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c772566-592a-48a4-b2b3-403016350763 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.601649 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c772566-592a-48a4-b2b3-403016350763 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.601925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c772566-592a-48a4-b2b3-403016350763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.622242 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5c772566-592a-48a4-b2b3-403016350763 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:33.623441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5c772566-592a-48a4-b2b3-403016350763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:33.632637 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1412/2820] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:33.637192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc2cd3-8ae5-4623-9a14-67c414bfbe0d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:33.647618 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc2cd3-8ae5-4623-9a14-67c414bfbe0d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:33.652958 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05ca81-30ad-45e8-ae8a-e03ccf731b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:33.653621 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05ca81-30ad-45e8-ae8a-e03ccf731b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.653894 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05ca81-30ad-45e8-ae8a-e03ccf731b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.654159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05ca81-30ad-45e8-ae8a-e03ccf731b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.654877 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05ca81-30ad-45e8-ae8a-e03ccf731b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:35:33.655158 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05ca81-30ad-45e8-ae8a-e03ccf731b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:33.656792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05ca81-30ad-45e8-ae8a-e03ccf731b3b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:33.669392 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1409/2821] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:35:33.674011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c772566-592a-48a4-b2b3-403016350763 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:33.684658 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c772566-592a-48a4-b2b3-403016350763 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:33.689655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f391-0ad0-482c-8b0b-21bba4cb4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:33.690269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f391-0ad0-482c-8b0b-21bba4cb4bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.690545 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f391-0ad0-482c-8b0b-21bba4cb4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.690818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f391-0ad0-482c-8b0b-21bba4cb4bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.691485 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f391-0ad0-482c-8b0b-21bba4cb4bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:33.693816 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f391-0ad0-482c-8b0b-21bba4cb4bbd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:33.724218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1413/2822] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:33 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:33.728612 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05ca81-30ad-45e8-ae8a-e03ccf731b3b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:33.739166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05ca81-30ad-45e8-ae8a-e03ccf731b3b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:33.795980 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db458-a4f3-4ec3-9d76-b904340e63e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:33.796666 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db458-a4f3-4ec3-9d76-b904340e63e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.796953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db458-a4f3-4ec3-9d76-b904340e63e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.797234 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db458-a4f3-4ec3-9d76-b904340e63e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.797942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8db458-a4f3-4ec3-9d76-b904340e63e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:33.799876 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8db458-a4f3-4ec3-9d76-b904340e63e5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:33.816675 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:33.826303 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1410/2823] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:33 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:33.827514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f391-0ad0-482c-8b0b-21bba4cb4bbd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:33.839178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f391-0ad0-482c-8b0b-21bba4cb4bbd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:33.844844 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04437ba1-14c9-4c68-beab-4cf5a8a1213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:33.845506 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04437ba1-14c9-4c68-beab-4cf5a8a1213c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.845790 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04437ba1-14c9-4c68-beab-4cf5a8a1213c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.846094 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04437ba1-14c9-4c68-beab-4cf5a8a1213c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.846809 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04437ba1-14c9-4c68-beab-4cf5a8a1213c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:33.848432 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04437ba1-14c9-4c68-beab-4cf5a8a1213c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:33.859101 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1414/2824] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:33.863611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db458-a4f3-4ec3-9d76-b904340e63e5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:33.874092 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db458-a4f3-4ec3-9d76-b904340e63e5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:33.879159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810d85e-3819-41cc-a803-42261c48d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:33.879787 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810d85e-3819-41cc-a803-42261c48d7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.880071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810d85e-3819-41cc-a803-42261c48d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.880364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810d85e-3819-41cc-a803-42261c48d7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.881059 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810d85e-3819-41cc-a803-42261c48d7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:33.882694 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810d85e-3819-41cc-a803-42261c48d7f2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:33.893702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1411/2825] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:33.898358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04437ba1-14c9-4c68-beab-4cf5a8a1213c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:33.909668 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04437ba1-14c9-4c68-beab-4cf5a8a1213c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:33.914981 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf8a9a-d745-4326-b7c9-2f3b279c132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:33.915653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8a9a-d745-4326-b7c9-2f3b279c132e admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.915928 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8a9a-d745-4326-b7c9-2f3b279c132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.916199 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8a9a-d745-4326-b7c9-2f3b279c132e admin admin] PATH_INFO: `/v3/projects/a35c131e79494263adb945b1b7526ba2/users/ee744b8eb821421fafc88e29f47cd37c/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.932838 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf8a9a-d745-4326-b7c9-2f3b279c132e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35c131e79494263adb945b1b7526ba2, user_id=ee744b8eb821421fafc88e29f47cd37c, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:33.935676 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf8a9a-d745-4326-b7c9-2f3b279c132e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:33.950361 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1415/2826] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:33 2022] PUT /identity/v3/projects/a35c131e79494263adb945b1b7526ba2/users/ee744b8eb821421fafc88e29f47cd37c/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:33.962407 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3686-6267-4c5d-bb24-ef3ae4a1cb6d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:33.962692 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3686-6267-4c5d-bb24-ef3ae4a1cb6d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:33.962939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3686-6267-4c5d-bb24-ef3ae4a1cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:33.993682 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c03d3686-6267-4c5d-bb24-ef3ae4a1cb6d None None] MFA Rules not processed for user `ee744b8eb821421fafc88e29f47cd37c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:33.994820 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c03d3686-6267-4c5d-bb24-ef3ae4a1cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:34.080984 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1412/2827] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:34.085931 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf8a9a-d745-4326-b7c9-2f3b279c132e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:34.150552 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf8a9a-d745-4326-b7c9-2f3b279c132e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:34.156468 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6599d2-4ce5-4e58-8025-8280124c119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:34.157109 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6599d2-4ce5-4e58-8025-8280124c119d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.157425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6599d2-4ce5-4e58-8025-8280124c119d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.157696 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6599d2-4ce5-4e58-8025-8280124c119d admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.158370 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6599d2-4ce5-4e58-8025-8280124c119d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:34.160306 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6599d2-4ce5-4e58-8025-8280124c119d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:34.189628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1416/2828] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:34 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:34.194310 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d3686-6267-4c5d-bb24-ef3ae4a1cb6d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:34.205485 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d3686-6267-4c5d-bb24-ef3ae4a1cb6d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:34.264567 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352182c-85be-4366-b457-af3bf7297311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:34.265136 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352182c-85be-4366-b457-af3bf7297311 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.265443 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352182c-85be-4366-b457-af3bf7297311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.265718 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352182c-85be-4366-b457-af3bf7297311 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.266383 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352182c-85be-4366-b457-af3bf7297311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:34.268307 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352182c-85be-4366-b457-af3bf7297311 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:34.292301 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1413/2829] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:34 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:34.296484 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6599d2-4ce5-4e58-8025-8280124c119d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:34.308071 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6599d2-4ce5-4e58-8025-8280124c119d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:34.313358 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84743ed3-ff29-48ca-b086-018c2e3b5505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:34.314065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84743ed3-ff29-48ca-b086-018c2e3b5505 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.314412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84743ed3-ff29-48ca-b086-018c2e3b5505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.314751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84743ed3-ff29-48ca-b086-018c2e3b5505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.315568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84743ed3-ff29-48ca-b086-018c2e3b5505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:34.317239 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84743ed3-ff29-48ca-b086-018c2e3b5505 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:34.329197 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1417/2830] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:34.333528 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352182c-85be-4366-b457-af3bf7297311 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:34.347500 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352182c-85be-4366-b457-af3bf7297311 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:34.352440 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933c4d6-8e16-4f88-9897-a43058785984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:34.353225 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933c4d6-8e16-4f88-9897-a43058785984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.353461 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933c4d6-8e16-4f88-9897-a43058785984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.353794 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933c4d6-8e16-4f88-9897-a43058785984 admin admin] PATH_INFO: `/v3/projects/ce1704b7dc844af182e1a86ee0770400/users/348e97db77e04a80ac26d18c4673cab0/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.371327 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933c4d6-8e16-4f88-9897-a43058785984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1704b7dc844af182e1a86ee0770400, user_id=348e97db77e04a80ac26d18c4673cab0, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:34.373938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933c4d6-8e16-4f88-9897-a43058785984 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:34.394102 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1414/2831] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:34 2022] PUT /identity/v3/projects/ce1704b7dc844af182e1a86ee0770400/users/348e97db77e04a80ac26d18c4673cab0/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:34.398217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84743ed3-ff29-48ca-b086-018c2e3b5505 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:34.410065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84743ed3-ff29-48ca-b086-018c2e3b5505 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:34.419077 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68849217-5316-435e-9884-6258dd3300a7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.419360 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68849217-5316-435e-9884-6258dd3300a7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.419632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68849217-5316-435e-9884-6258dd3300a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.440471 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-68849217-5316-435e-9884-6258dd3300a7 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:34.441953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-68849217-5316-435e-9884-6258dd3300a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:34.459459 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:34.492719 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876df274-02f7-442e-9a9f-253a5c35ea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:34.494001 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876df274-02f7-442e-9a9f-253a5c35ea33 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.494497 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876df274-02f7-442e-9a9f-253a5c35ea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.495177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876df274-02f7-442e-9a9f-253a5c35ea33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.495634 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:34.496556 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876df274-02f7-442e-9a9f-253a5c35ea33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:34.499694 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876df274-02f7-442e-9a9f-253a5c35ea33 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:34.519431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1418/2832] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:34.525492 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876df274-02f7-442e-9a9f-253a5c35ea33 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:34.528199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1415/2833] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:35:34.537234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876df274-02f7-442e-9a9f-253a5c35ea33 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:34.542546 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388438e-5dd8-4ec4-9486-61f79159a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:34.543261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388438e-5dd8-4ec4-9486-61f79159a9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.543538 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388438e-5dd8-4ec4-9486-61f79159a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.543814 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388438e-5dd8-4ec4-9486-61f79159a9b0 admin admin] PATH_INFO: `/v3/projects/ce1704b7dc844af182e1a86ee0770400/users/348e97db77e04a80ac26d18c4673cab0/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.545951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388438e-5dd8-4ec4-9486-61f79159a9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1704b7dc844af182e1a86ee0770400, user_id=348e97db77e04a80ac26d18c4673cab0, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:34.548681 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388438e-5dd8-4ec4-9486-61f79159a9b0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:34.561644 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1419/2834] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:34 2022] PUT /identity/v3/projects/ce1704b7dc844af182e1a86ee0770400/users/348e97db77e04a80ac26d18c4673cab0/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:34.561859 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68849217-5316-435e-9884-6258dd3300a7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:34.564264 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-68849217-5316-435e-9884-6258dd3300a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:34.582325 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e528-04ac-46b3-a1bd-bdb567ccf6f1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.582718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e528-04ac-46b3-a1bd-bdb567ccf6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.583171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e528-04ac-46b3-a1bd-bdb567ccf6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.623583 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-22c3e528-04ac-46b3-a1bd-bdb567ccf6f1 None None] MFA Rules not processed for user `348e97db77e04a80ac26d18c4673cab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:34.624882 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-22c3e528-04ac-46b3-a1bd-bdb567ccf6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:34.680645 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68849217-5316-435e-9884-6258dd3300a7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:34.704732 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1420/2835] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:34.716750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e528-04ac-46b3-a1bd-bdb567ccf6f1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:34.718207 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-22c3e528-04ac-46b3-a1bd-bdb567ccf6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:34.750833 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f431e2-a899-4c81-a99b-00add25378b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:34.751620 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f431e2-a899-4c81-a99b-00add25378b3 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.751792 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f431e2-a899-4c81-a99b-00add25378b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.751991 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f431e2-a899-4c81-a99b-00add25378b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.779872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e528-04ac-46b3-a1bd-bdb567ccf6f1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:34.783841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906988b-1d47-4f6c-9704-be3430e16948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:34.784475 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906988b-1d47-4f6c-9704-be3430e16948 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.784783 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906988b-1d47-4f6c-9704-be3430e16948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.785059 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906988b-1d47-4f6c-9704-be3430e16948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.795261 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906988b-1d47-4f6c-9704-be3430e16948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:34.796864 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906988b-1d47-4f6c-9704-be3430e16948 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:34.806548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1421/2836] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:35:34.816695 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f431e2-a899-4c81-a99b-00add25378b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:34.818712 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f431e2-a899-4c81-a99b-00add25378b3 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:34.828705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1416/2837] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:35:34.884256 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906988b-1d47-4f6c-9704-be3430e16948 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:34.893580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906988b-1d47-4f6c-9704-be3430e16948 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:34.897217 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b641c5b-5c36-4992-8cd4-0939a8fddbc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:34.897893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641c5b-5c36-4992-8cd4-0939a8fddbc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:34.898148 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641c5b-5c36-4992-8cd4-0939a8fddbc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:34.898437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641c5b-5c36-4992-8cd4-0939a8fddbc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:34.949735 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:34.963548 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b641c5b-5c36-4992-8cd4-0939a8fddbc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:34.965011 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b641c5b-5c36-4992-8cd4-0939a8fddbc2 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:34.974204 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1422/2838] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:35.265429 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f431e2-a899-4c81-a99b-00add25378b3 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:35.276326 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f431e2-a899-4c81-a99b-00add25378b3 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:35.282096 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:35.282742 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:35.283032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:35.283320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] PATH_INFO: `/v3/users/ee744b8eb821421fafc88e29f47cd37c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:35.284571 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee744b8eb821421fafc88e29f47cd37c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:35.286539 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:35.292371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:35.338087 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee744b8eb821421fafc88e29f47cd37c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.345947 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee744b8eb821421fafc88e29f47cd37c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.358194 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee744b8eb821421fafc88e29f47cd37c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.365123 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee744b8eb821421fafc88e29f47cd37c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.365878 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee744b8eb821421fafc88e29f47cd37c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.371911 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1417/2839] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:35 2022] DELETE /identity/v3/users/ee744b8eb821421fafc88e29f47cd37c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:35.378104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe980-8a07-4073-874e-4b8af2ef4437 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:35.378104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe980-8a07-4073-874e-4b8af2ef4437 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:35.378104 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe980-8a07-4073-874e-4b8af2ef4437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:35.399270 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-86dbe980-8a07-4073-874e-4b8af2ef4437 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:35.400553 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-86dbe980-8a07-4073-874e-4b8af2ef4437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:35.469028 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1423/2840] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:35.482362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:35.483815 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:35.550510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc82e-b3bd-4f94-93a7-d231bfd90fbc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:35.554614 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270c8ae-f477-4874-83b0-7202750c3805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:35.555242 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270c8ae-f477-4874-83b0-7202750c3805 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:35.555521 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270c8ae-f477-4874-83b0-7202750c3805 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:35.555796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270c8ae-f477-4874-83b0-7202750c3805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:35.566874 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270c8ae-f477-4874-83b0-7202750c3805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:35.568677 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270c8ae-f477-4874-83b0-7202750c3805 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:35.579302 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1418/2841] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:35.874588 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe980-8a07-4073-874e-4b8af2ef4437 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:35.876073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-86dbe980-8a07-4073-874e-4b8af2ef4437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:35.889423 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe980-8a07-4073-874e-4b8af2ef4437 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:35.895456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:35.896168 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:35.896436 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:35.896718 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] PATH_INFO: `/v3/projects/a35c131e79494263adb945b1b7526ba2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:35.897985 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35c131e79494263adb945b1b7526ba2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:35.899919 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:35.949625 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35c131e79494263adb945b1b7526ba2', 'request_id': 'req-08728ba5-3632-4f5a-be05-d207f51b4a2e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.958543 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35c131e79494263adb945b1b7526ba2', 'request_id': 'req-08728ba5-3632-4f5a-be05-d207f51b4a2e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.964412 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35c131e79494263adb945b1b7526ba2', 'request_id': 'req-08728ba5-3632-4f5a-be05-d207f51b4a2e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.975791 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] The token cache is being invalidate because project a35c131e79494263adb945b1b7526ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:35.976087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.976726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:35.978340 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1424/2842] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:35 2022] DELETE /identity/v3/projects/a35c131e79494263adb945b1b7526ba2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:35.982942 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270c8ae-f477-4874-83b0-7202750c3805 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:35.996715 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270c8ae-f477-4874-83b0-7202750c3805 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:36.055034 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:36.055691 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:36.055970 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:36.056233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] PATH_INFO: `/v3/users/348e97db77e04a80ac26d18c4673cab0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:36.057488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] RBAC: Authorizing `identity:delete_user(user_id=348e97db77e04a80ac26d18c4673cab0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:36.059414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:36.096606 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:36.111814 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348e97db77e04a80ac26d18c4673cab0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.119499 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348e97db77e04a80ac26d18c4673cab0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.134137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348e97db77e04a80ac26d18c4673cab0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.142244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348e97db77e04a80ac26d18c4673cab0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.142997 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c43f77b4-24c2-4a21-97da-4caff34b024a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348e97db77e04a80ac26d18c4673cab0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.149295 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1419/2843] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:35 2022] DELETE /identity/v3/users/348e97db77e04a80ac26d18c4673cab0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:36.434181 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:36.436236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:36.459360 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08728ba5-3632-4f5a-be05-d207f51b4a2e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:36.522407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:36.523074 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:36.523359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:36.523667 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] PATH_INFO: `/v3/projects/ce1704b7dc844af182e1a86ee0770400` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:36.524905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1704b7dc844af182e1a86ee0770400)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:36.526917 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:36.546635 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:36.585959 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1704b7dc844af182e1a86ee0770400', 'request_id': 'req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.597803 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1704b7dc844af182e1a86ee0770400', 'request_id': 'req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.604808 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1704b7dc844af182e1a86ee0770400', 'request_id': 'req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.617087 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] The token cache is being invalidate because project ce1704b7dc844af182e1a86ee0770400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:36.617399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.618105 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd20a440-0ef2-40f7-bc60-1faeca4a1c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:36.619684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1425/2844] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:36 2022] DELETE /identity/v3/projects/ce1704b7dc844af182e1a86ee0770400 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:36.625113 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c298a6-88cc-45d6-be86-eb7f71b6131f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:36.625719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c298a6-88cc-45d6-be86-eb7f71b6131f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:36.625719 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c298a6-88cc-45d6-be86-eb7f71b6131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:36.648548 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e1c298a6-88cc-45d6-be86-eb7f71b6131f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:36.649890 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e1c298a6-88cc-45d6-be86-eb7f71b6131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:36.718413 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1420/2845] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:36.726898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f768-33af-41dc-9aa0-cfb9db6bbfda None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:36.727186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f768-33af-41dc-9aa0-cfb9db6bbfda None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:36.727456 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f768-33af-41dc-9aa0-cfb9db6bbfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:36.749067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a7f4f768-33af-41dc-9aa0-cfb9db6bbfda None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:36.750682 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a7f4f768-33af-41dc-9aa0-cfb9db6bbfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:36.758920 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1426/2846] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:36.763362 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c298a6-88cc-45d6-be86-eb7f71b6131f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:36.774727 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c298a6-88cc-45d6-be86-eb7f71b6131f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:36.780864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de379e-3bf1-4e7f-85e2-a15ebc22f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:36.781564 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de379e-3bf1-4e7f-85e2-a15ebc22f2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:36.781844 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de379e-3bf1-4e7f-85e2-a15ebc22f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:36.782115 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de379e-3bf1-4e7f-85e2-a15ebc22f2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:36.782849 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de379e-3bf1-4e7f-85e2-a15ebc22f2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:35:36.783153 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de379e-3bf1-4e7f-85e2-a15ebc22f2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:36.784765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de379e-3bf1-4e7f-85e2-a15ebc22f2b0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:36.798496 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1421/2847] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:35:36.803471 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4f768-33af-41dc-9aa0-cfb9db6bbfda None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:36.813573 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4f768-33af-41dc-9aa0-cfb9db6bbfda None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:36.818958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2f7d9-5d56-4676-ab38-6e270587e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:36.819630 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f7d9-5d56-4676-ab38-6e270587e12b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:36.819977 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f7d9-5d56-4676-ab38-6e270587e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:36.820198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f7d9-5d56-4676-ab38-6e270587e12b admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:36.821156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2f7d9-5d56-4676-ab38-6e270587e12b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:36.822925 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2f7d9-5d56-4676-ab38-6e270587e12b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:36.852494 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1427/2848] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:35:36 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:36.857558 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de379e-3bf1-4e7f-85e2-a15ebc22f2b0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:36.869400 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de379e-3bf1-4e7f-85e2-a15ebc22f2b0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:36.933196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c1634-d932-4671-a10e-57fede76f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:36.933879 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c1634-d932-4671-a10e-57fede76f397 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:36.934150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c1634-d932-4671-a10e-57fede76f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:36.936286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c1634-d932-4671-a10e-57fede76f397 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:36.936286 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c1634-d932-4671-a10e-57fede76f397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:36.937028 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c1634-d932-4671-a10e-57fede76f397 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:36.962510 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1422/2849] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:35:36 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:35:36.967085 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2f7d9-5d56-4676-ab38-6e270587e12b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:36.979120 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2f7d9-5d56-4676-ab38-6e270587e12b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:36.986534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1edbfb-ddce-4b71-bc0d-4a4f329e4855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:36.987186 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1edbfb-ddce-4b71-bc0d-4a4f329e4855 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:36.987463 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1edbfb-ddce-4b71-bc0d-4a4f329e4855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:36.987731 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1edbfb-ddce-4b71-bc0d-4a4f329e4855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:36.988465 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1edbfb-ddce-4b71-bc0d-4a4f329e4855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:36.990336 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1edbfb-ddce-4b71-bc0d-4a4f329e4855 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:37.002580 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1428/2850] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:37.006680 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c1634-d932-4671-a10e-57fede76f397 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:37.017681 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c1634-d932-4671-a10e-57fede76f397 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:37.022553 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e80da-c02e-4d7d-bbb3-9b194a7af61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:37.023191 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e80da-c02e-4d7d-bbb3-9b194a7af61b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:37.023472 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e80da-c02e-4d7d-bbb3-9b194a7af61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:37.023738 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e80da-c02e-4d7d-bbb3-9b194a7af61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:37.024438 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e80da-c02e-4d7d-bbb3-9b194a7af61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:37.026173 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e80da-c02e-4d7d-bbb3-9b194a7af61b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:37.038864 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1423/2851] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:35:37.046185 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1edbfb-ddce-4b71-bc0d-4a4f329e4855 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:37.057878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1edbfb-ddce-4b71-bc0d-4a4f329e4855 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:37.064841 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8eb43-67cb-4f14-a051-c014d7b33b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:37.065281 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8eb43-67cb-4f14-a051-c014d7b33b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:37.065769 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8eb43-67cb-4f14-a051-c014d7b33b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:37.066048 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8eb43-67cb-4f14-a051-c014d7b33b27 admin admin] PATH_INFO: `/v3/projects/2ca7e459586a49faa25fa194e67d2484/users/3b1c4cad970c4e58a2217dd0fbdd5691/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:37.088175 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8eb43-67cb-4f14-a051-c014d7b33b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca7e459586a49faa25fa194e67d2484, user_id=3b1c4cad970c4e58a2217dd0fbdd5691, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:37.091004 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8eb43-67cb-4f14-a051-c014d7b33b27 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:37.108177 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1429/2852] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:35:37 2022] PUT /identity/v3/projects/2ca7e459586a49faa25fa194e67d2484/users/3b1c4cad970c4e58a2217dd0fbdd5691/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:37.119547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d251e2-96e9-4d43-a91d-d786b0d4436a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:37.119946 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d251e2-96e9-4d43-a91d-d786b0d4436a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:37.120192 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d251e2-96e9-4d43-a91d-d786b0d4436a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:37.149359 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:37.153941 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-82d251e2-96e9-4d43-a91d-d786b0d4436a None None] MFA Rules not processed for user `3b1c4cad970c4e58a2217dd0fbdd5691`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:37.156464 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-82d251e2-96e9-4d43-a91d-d786b0d4436a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:37.231702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1424/2853] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:37.243951 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8eb43-67cb-4f14-a051-c014d7b33b27 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:37.245902 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-90d8eb43-67cb-4f14-a051-c014d7b33b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:37.306911 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8eb43-67cb-4f14-a051-c014d7b33b27 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:37.311408 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a00f0-a75e-4bad-92bd-f45c91edacb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59f6195586c7434ab85604181ec2a076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:37.312041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a00f0-a75e-4bad-92bd-f45c91edacb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:37.312321 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a00f0-a75e-4bad-92bd-f45c91edacb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:37.312594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a00f0-a75e-4bad-92bd-f45c91edacb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:37.323967 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a00f0-a75e-4bad-92bd-f45c91edacb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:37.325464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a00f0-a75e-4bad-92bd-f45c91edacb3 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:37.335437 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1430/2854] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:47.228306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=26 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:47.330724 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:47.661082 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d251e2-96e9-4d43-a91d-d786b0d4436a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:47.731415 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d251e2-96e9-4d43-a91d-d786b0d4436a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:47.736486 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:47.737181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:47.737490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:47.737768 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] PATH_INFO: `/v3/users/3b1c4cad970c4e58a2217dd0fbdd5691` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:47.739137 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1c4cad970c4e58a2217dd0fbdd5691)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:47.741130 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:47.791538 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1c4cad970c4e58a2217dd0fbdd5691'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:47.798929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1c4cad970c4e58a2217dd0fbdd5691'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:47.813522 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1c4cad970c4e58a2217dd0fbdd5691'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:47.822730 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1c4cad970c4e58a2217dd0fbdd5691'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:47.823740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1c4cad970c4e58a2217dd0fbdd5691'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:47.830297 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1425/2855] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:35:47 2022] DELETE /identity/v3/users/3b1c4cad970c4e58a2217dd0fbdd5691 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:47.836237 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68a95c-a367-4965-94e0-02e7be19b894 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:47.836521 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68a95c-a367-4965-94e0-02e7be19b894 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:47.836793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68a95c-a367-4965-94e0-02e7be19b894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:47.856915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8a68a95c-a367-4965-94e0-02e7be19b894 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:47.859161 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8a68a95c-a367-4965-94e0-02e7be19b894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:47.929971 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1431/2856] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:47.939895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:47.941534 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:48.008377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fe8b1-8e36-49ff-83ec-2382569e5df9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:48.015484 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e84e20-fc67-45c1-80b6-1195173f508a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:48.016449 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84e20-fc67-45c1-80b6-1195173f508a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:48.016836 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84e20-fc67-45c1-80b6-1195173f508a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:48.017238 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84e20-fc67-45c1-80b6-1195173f508a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:48.031121 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e84e20-fc67-45c1-80b6-1195173f508a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:48.033284 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e84e20-fc67-45c1-80b6-1195173f508a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:48.048200 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1426/2857] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:48.338354 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68a95c-a367-4965-94e0-02e7be19b894 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:48.339962 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8a68a95c-a367-4965-94e0-02e7be19b894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:48.353051 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68a95c-a367-4965-94e0-02e7be19b894 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:48.361759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:48.362898 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:48.363417 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:48.363942 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] PATH_INFO: `/v3/projects/2ca7e459586a49faa25fa194e67d2484` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:48.366320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca7e459586a49faa25fa194e67d2484)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:48.370067 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:48.440608 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca7e459586a49faa25fa194e67d2484', 'request_id': 'req-597d13cd-eb18-4c11-a9ad-0f9429182514'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:48.450347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca7e459586a49faa25fa194e67d2484', 'request_id': 'req-597d13cd-eb18-4c11-a9ad-0f9429182514'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:48.459337 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca7e459586a49faa25fa194e67d2484', 'request_id': 'req-597d13cd-eb18-4c11-a9ad-0f9429182514'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:48.474539 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] The token cache is being invalidate because project 2ca7e459586a49faa25fa194e67d2484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:35:48.474822 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:48.475595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:35:48.477198 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1432/2858] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:35:48 2022] DELETE /identity/v3/projects/2ca7e459586a49faa25fa194e67d2484 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:35:49.815632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16747-1c6f-431a-99e1-eb9ea46583f0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:49.816262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16747-1c6f-431a-99e1-eb9ea46583f0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:49.816262 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16747-1c6f-431a-99e1-eb9ea46583f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:49.837149 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-08f16747-1c6f-431a-99e1-eb9ea46583f0 None None] MFA Rules not processed for user `52123d6a3694456a9a29c8987ec62bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:35:49.838490 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-08f16747-1c6f-431a-99e1-eb9ea46583f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:49.857873 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:35:49.915226 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1427/2859] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:35:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:35:50.155632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:35:50.157434 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:50.244207 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d13cd-eb18-4c11-a9ad-0f9429182514 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:35:50.249632 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:35:50.250279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:35:50.250558 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:35:50.250848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:35:50.252847 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:35:50.263291 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:35:50.264747 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:35:50.273568 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1433/2860] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:35:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:35:59.906050 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=15 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:00.269665 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:05.418359 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12fff3-61ba-431d-80db-5323f72deedb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:05.418953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12fff3-61ba-431d-80db-5323f72deedb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:05.418953 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12fff3-61ba-431d-80db-5323f72deedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:05.441159 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1d12fff3-61ba-431d-80db-5323f72deedb None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:05.442427 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1d12fff3-61ba-431d-80db-5323f72deedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:05.511537 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1428/2861] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:05.533031 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:05.534788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:05.620254 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789daad4-d40a-44bd-947e-cc6edfa4be8b service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:05.629648 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8147-3fac-4dcd-b6e6-56163ce31ecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:05.630713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8147-3fac-4dcd-b6e6-56163ce31ecb service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:05.631065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8147-3fac-4dcd-b6e6-56163ce31ecb service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:05.631401 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8147-3fac-4dcd-b6e6-56163ce31ecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:05.640867 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c8147-3fac-4dcd-b6e6-56163ce31ecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:05.642562 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c8147-3fac-4dcd-b6e6-56163ce31ecb service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:05.652744 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1434/2862] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:36:08.698026 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b1a3-a6c2-4632-a91d-28fa8b404051 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:08.698652 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b1a3-a6c2-4632-a91d-28fa8b404051 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:08.698766 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b1a3-a6c2-4632-a91d-28fa8b404051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:08.720690 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f8e5b1a3-a6c2-4632-a91d-28fa8b404051 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:08.722406 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f8e5b1a3-a6c2-4632-a91d-28fa8b404051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:08.731702 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1429/2863] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:08.765405 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8147-3fac-4dcd-b6e6-56163ce31ecb service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:08.767132 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-540c8147-3fac-4dcd-b6e6-56163ce31ecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:08.784047 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8147-3fac-4dcd-b6e6-56163ce31ecb service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:08.791116 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960127a-7640-4324-99d8-1c7335d5728e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:08.791751 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960127a-7640-4324-99d8-1c7335d5728e service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:08.792027 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960127a-7640-4324-99d8-1c7335d5728e service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:08.792299 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960127a-7640-4324-99d8-1c7335d5728e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:08.801068 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960127a-7640-4324-99d8-1c7335d5728e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:08.802692 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960127a-7640-4324-99d8-1c7335d5728e service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:08.812890 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1435/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:36:11.793989 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe47bf0-6084-4c20-b29e-445bd0ca2d00 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:11.794507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe47bf0-6084-4c20-b29e-445bd0ca2d00 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:11.794507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe47bf0-6084-4c20-b29e-445bd0ca2d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:11.818143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3fe47bf0-6084-4c20-b29e-445bd0ca2d00 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:11.819743 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3fe47bf0-6084-4c20-b29e-445bd0ca2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:11.828761 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1430/2865] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:11.851431 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960127a-7640-4324-99d8-1c7335d5728e service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:11.863259 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960127a-7640-4324-99d8-1c7335d5728e service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:11.869457 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc69d4-4fdd-47f5-918d-9b0417800958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:11.870065 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc69d4-4fdd-47f5-918d-9b0417800958 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:11.870344 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc69d4-4fdd-47f5-918d-9b0417800958 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:11.870603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc69d4-4fdd-47f5-918d-9b0417800958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:11.879220 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc69d4-4fdd-47f5-918d-9b0417800958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:11.880793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc69d4-4fdd-47f5-918d-9b0417800958 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:11.890860 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1436/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:36:14.964507 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e5fa-e332-42bc-8489-b1a1f2e47588 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:14.965122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e5fa-e332-42bc-8489-b1a1f2e47588 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:14.965122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e5fa-e332-42bc-8489-b1a1f2e47588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:14.989023 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-60c5e5fa-e332-42bc-8489-b1a1f2e47588 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:14.990662 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-60c5e5fa-e332-42bc-8489-b1a1f2e47588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:14.999442 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1431/2867] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:15.023158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc69d4-4fdd-47f5-918d-9b0417800958 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:15.034980 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc69d4-4fdd-47f5-918d-9b0417800958 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:15.041376 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff0185-950b-40bf-bf27-6d1ca3e78122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:15.041989 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff0185-950b-40bf-bf27-6d1ca3e78122 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:15.042264 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff0185-950b-40bf-bf27-6d1ca3e78122 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:15.042557 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff0185-950b-40bf-bf27-6d1ca3e78122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:15.051257 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff0185-950b-40bf-bf27-6d1ca3e78122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:15.052881 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff0185-950b-40bf-bf27-6d1ca3e78122 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:15.062745 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1437/2868] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:36:18.144237 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703ffb-c26f-417b-bb15-ec097abdb24b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:18.146348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703ffb-c26f-417b-bb15-ec097abdb24b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:18.146348 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703ffb-c26f-417b-bb15-ec097abdb24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:18.170213 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3d703ffb-c26f-417b-bb15-ec097abdb24b None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:18.171363 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3d703ffb-c26f-417b-bb15-ec097abdb24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:18.180027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1432/2869] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 07:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:18.232691 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff0185-950b-40bf-bf27-6d1ca3e78122 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:18.245628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff0185-950b-40bf-bf27-6d1ca3e78122 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:18.252269 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e898fd6-9812-4aba-9f11-549ec0e1d82b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:18.252887 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e898fd6-9812-4aba-9f11-549ec0e1d82b service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:18.253160 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e898fd6-9812-4aba-9f11-549ec0e1d82b service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:18.253464 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e898fd6-9812-4aba-9f11-549ec0e1d82b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:18.262572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e898fd6-9812-4aba-9f11-549ec0e1d82b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:18.264162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e898fd6-9812-4aba-9f11-549ec0e1d82b service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:18.274241 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1438/2870] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:36:27.931686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703ffb-c26f-417b-bb15-ec097abdb24b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:27.933352 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3d703ffb-c26f-417b-bb15-ec097abdb24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:28.028306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703ffb-c26f-417b-bb15-ec097abdb24b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:28.034385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbb54f-d99d-411c-b65f-70dd34530ba7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:28.035027 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbb54f-d99d-411c-b65f-70dd34530ba7 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:28.035305 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbb54f-d99d-411c-b65f-70dd34530ba7 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:28.035574 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbb54f-d99d-411c-b65f-70dd34530ba7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:28.037603 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-10bbb54f-d99d-411c-b65f-70dd34530ba7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:28.050335 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbb54f-d99d-411c-b65f-70dd34530ba7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:28.051934 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbb54f-d99d-411c-b65f-70dd34530ba7 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:28.062560 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1433/2871] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:36:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:36:28.269547 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=58 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:38.058175 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=80 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:47.967248 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e898fd6-9812-4aba-9f11-549ec0e1d82b service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:47.968805 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0e898fd6-9812-4aba-9f11-549ec0e1d82b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:47.982979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e898fd6-9812-4aba-9f11-549ec0e1d82b service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:47.988655 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:47.989330 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:47.989610 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:47.989877 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] PATH_INFO: `/v3/users/52123d6a3694456a9a29c8987ec62bd6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:47.991202 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52123d6a3694456a9a29c8987ec62bd6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:47.993143 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:48.049878 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52123d6a3694456a9a29c8987ec62bd6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.050788 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52123d6a3694456a9a29c8987ec62bd6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.051628 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52123d6a3694456a9a29c8987ec62bd6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.068366 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52123d6a3694456a9a29c8987ec62bd6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.079498 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-513d94cb-838d-4da9-b690-db8c2ecbf437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52123d6a3694456a9a29c8987ec62bd6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.091749 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1439/2872] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:36:47 2022] DELETE /identity/v3/users/52123d6a3694456a9a29c8987ec62bd6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:36:48.270918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbb54f-d99d-411c-b65f-70dd34530ba7 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:48.283358 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbb54f-d99d-411c-b65f-70dd34530ba7 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:48.346258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:48.346919 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.347199 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.347473 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] PATH_INFO: `/v3/projects/86ee0e4119314438be2f1855d52e26ae` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.348670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ee0e4119314438be2f1855d52e26ae)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:48.350616 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:48.399145 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ee0e4119314438be2f1855d52e26ae', 'request_id': 'req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.407319 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ee0e4119314438be2f1855d52e26ae', 'request_id': 'req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.415216 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ee0e4119314438be2f1855d52e26ae', 'request_id': 'req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.430398 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] The token cache is being invalidate because project 86ee0e4119314438be2f1855d52e26ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:36:48.430736 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.431750 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2085e48a-c4c9-4c38-9dda-e3e00f63c11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:36:48.433611 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1434/2873] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:36:48 2022] DELETE /identity/v3/projects/86ee0e4119314438be2f1855d52e26ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:36:48.440927 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec89d-7cbc-44cb-bffe-746351a80013 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.441388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec89d-7cbc-44cb-bffe-746351a80013 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.442178 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec89d-7cbc-44cb-bffe-746351a80013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.468900 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-63eec89d-7cbc-44cb-bffe-746351a80013 None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:48.470253 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-63eec89d-7cbc-44cb-bffe-746351a80013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:48.530234 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1440/2874] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:48.543650 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d20e8-aac4-4a3d-8e2f-7cab2d15cf3f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.543913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d20e8-aac4-4a3d-8e2f-7cab2d15cf3f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.544252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d20e8-aac4-4a3d-8e2f-7cab2d15cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.569197 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e34d20e8-aac4-4a3d-8e2f-7cab2d15cf3f None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:48.570488 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e34d20e8-aac4-4a3d-8e2f-7cab2d15cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:48.580414 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1435/2875] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:48.584983 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eec89d-7cbc-44cb-bffe-746351a80013 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:48.595479 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eec89d-7cbc-44cb-bffe-746351a80013 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:48.603634 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c54c-086b-46cd-ac89-edd012bf1cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:48.604603 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c54c-086b-46cd-ac89-edd012bf1cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.605073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c54c-086b-46cd-ac89-edd012bf1cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.605530 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c54c-086b-46cd-ac89-edd012bf1cb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.606246 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9c54c-086b-46cd-ac89-edd012bf1cb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:36:48.606549 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9c54c-086b-46cd-ac89-edd012bf1cb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:48.608162 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9c54c-086b-46cd-ac89-edd012bf1cb5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:48.620156 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1441/2876] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Jul 26 07:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:36:48.624829 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d20e8-aac4-4a3d-8e2f-7cab2d15cf3f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:48.636819 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d20e8-aac4-4a3d-8e2f-7cab2d15cf3f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:48.642127 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3992a66-3226-4f06-9a5a-13857607731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:48.642846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3992a66-3226-4f06-9a5a-13857607731a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.643053 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3992a66-3226-4f06-9a5a-13857607731a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.643320 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3992a66-3226-4f06-9a5a-13857607731a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.644003 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3992a66-3226-4f06-9a5a-13857607731a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:48.645963 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3992a66-3226-4f06-9a5a-13857607731a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:48.676543 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1436/2877] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:36:48 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:36:48.680818 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c54c-086b-46cd-ac89-edd012bf1cb5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:48.691086 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c54c-086b-46cd-ac89-edd012bf1cb5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:48.750034 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3f9ad-7f92-4c9c-b41a-e5614e5178e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:48.750689 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3f9ad-7f92-4c9c-b41a-e5614e5178e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.750958 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3f9ad-7f92-4c9c-b41a-e5614e5178e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.751236 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3f9ad-7f92-4c9c-b41a-e5614e5178e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.751915 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3f9ad-7f92-4c9c-b41a-e5614e5178e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:48.753906 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3f9ad-7f92-4c9c-b41a-e5614e5178e1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:48.762256 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:48.776585 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1442/2878] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:36:48 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:36:48.781006 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3992a66-3226-4f06-9a5a-13857607731a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:48.791583 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3992a66-3226-4f06-9a5a-13857607731a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:48.796686 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0f586-47b8-4d7a-a69c-83b18feba9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:48.797416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f586-47b8-4d7a-a69c-83b18feba9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.797704 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f586-47b8-4d7a-a69c-83b18feba9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.797981 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f586-47b8-4d7a-a69c-83b18feba9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.798689 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0f586-47b8-4d7a-a69c-83b18feba9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:48.800293 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0f586-47b8-4d7a-a69c-83b18feba9eb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:48.810684 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1437/2879] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:36:48.814932 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3f9ad-7f92-4c9c-b41a-e5614e5178e1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:48.826488 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3f9ad-7f92-4c9c-b41a-e5614e5178e1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:48.832446 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749364-ef93-442b-bf11-669c93909ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:48.833064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749364-ef93-442b-bf11-669c93909ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.833367 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749364-ef93-442b-bf11-669c93909ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.833708 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749364-ef93-442b-bf11-669c93909ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.834347 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749364-ef93-442b-bf11-669c93909ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:48.835966 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749364-ef93-442b-bf11-669c93909ad6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:48.847642 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1443/2880] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:36:48.852167 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0f586-47b8-4d7a-a69c-83b18feba9eb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:48.862751 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0f586-47b8-4d7a-a69c-83b18feba9eb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:48.867858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5826b-d4dc-4630-9d26-c9a28ebf9bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:48.868541 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5826b-d4dc-4630-9d26-c9a28ebf9bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.868851 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5826b-d4dc-4630-9d26-c9a28ebf9bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.869125 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5826b-d4dc-4630-9d26-c9a28ebf9bb9 admin admin] PATH_INFO: `/v3/projects/37cd424fff6c4ebaae4618a08c9a12f2/users/e31cb7b32ac3435295456f5b003ad43e/roles/c0c80af8168f45fc9fffd24abe0136f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.887181 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5826b-d4dc-4630-9d26-c9a28ebf9bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cd424fff6c4ebaae4618a08c9a12f2, user_id=e31cb7b32ac3435295456f5b003ad43e, role_id=c0c80af8168f45fc9fffd24abe0136f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:48.889932 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5826b-d4dc-4630-9d26-c9a28ebf9bb9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:48.904924 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1438/2881] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:36:48 2022] PUT /identity/v3/projects/37cd424fff6c4ebaae4618a08c9a12f2/users/e31cb7b32ac3435295456f5b003ad43e/roles/c0c80af8168f45fc9fffd24abe0136f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:36:48.913214 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c73e9-e5fb-4d89-94cb-02ee80f4551a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:48.913660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c73e9-e5fb-4d89-94cb-02ee80f4551a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:48.914035 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c73e9-e5fb-4d89-94cb-02ee80f4551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:48.935326 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cc7c73e9-e5fb-4d89-94cb-02ee80f4551a None None] MFA Rules not processed for user `8e22a2638d8e425c934033b96ce6b062`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:48.936551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cc7c73e9-e5fb-4d89-94cb-02ee80f4551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:48.999489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1444/2882] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:49.009647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5826b-d4dc-4630-9d26-c9a28ebf9bb9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:49.011649 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-55b5826b-d4dc-4630-9d26-c9a28ebf9bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:49.043901 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:49.072385 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5826b-d4dc-4630-9d26-c9a28ebf9bb9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:49.076391 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad047c9-7aca-4389-9ebe-18dddce4529c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:49.077017 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad047c9-7aca-4389-9ebe-18dddce4529c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:49.077298 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad047c9-7aca-4389-9ebe-18dddce4529c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:49.077607 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad047c9-7aca-4389-9ebe-18dddce4529c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:49.087122 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad047c9-7aca-4389-9ebe-18dddce4529c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:49.088555 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad047c9-7aca-4389-9ebe-18dddce4529c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:49.101451 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1439/2883] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:36:53.210245 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deeef1-012e-426f-a510-2653b5bbc084 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:53.210872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deeef1-012e-426f-a510-2653b5bbc084 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:53.210872 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deeef1-012e-426f-a510-2653b5bbc084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:53.244450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c7deeef1-012e-426f-a510-2653b5bbc084 None None] MFA Rules not processed for user `e31cb7b32ac3435295456f5b003ad43e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:53.245780 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c7deeef1-012e-426f-a510-2653b5bbc084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:53.317125 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1445/2884] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:36:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:53.322054 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad047c9-7aca-4389-9ebe-18dddce4529c service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:53.332039 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad047c9-7aca-4389-9ebe-18dddce4529c service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:53.336547 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4d82c-57be-413c-8734-3dde9e311fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:53.337172 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4d82c-57be-413c-8734-3dde9e311fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:53.337605 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4d82c-57be-413c-8734-3dde9e311fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:53.337755 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4d82c-57be-413c-8734-3dde9e311fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:53.338426 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4d82c-57be-413c-8734-3dde9e311fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:53.340343 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4d82c-57be-413c-8734-3dde9e311fd0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:53.373516 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1440/2885] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Jul 26 07:36:53 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:36:53.377684 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7deeef1-012e-426f-a510-2653b5bbc084 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:53.388998 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7deeef1-012e-426f-a510-2653b5bbc084 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:53.451029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efd69c-fcd1-432f-a0e5-d11e0b69c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:53.451661 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efd69c-fcd1-432f-a0e5-d11e0b69c116 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:53.451945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efd69c-fcd1-432f-a0e5-d11e0b69c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:53.452216 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efd69c-fcd1-432f-a0e5-d11e0b69c116 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:53.452918 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efd69c-fcd1-432f-a0e5-d11e0b69c116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:53.454905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efd69c-fcd1-432f-a0e5-d11e0b69c116 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:53.472905 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:36:53.483171 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1446/2886] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 26 07:36:53 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:36:53.484395 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4d82c-57be-413c-8734-3dde9e311fd0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:53.495143 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4d82c-57be-413c-8734-3dde9e311fd0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:53.501033 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27187b93-3709-4c9e-8563-72a98d1bac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:53.501930 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27187b93-3709-4c9e-8563-72a98d1bac62 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:53.502278 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27187b93-3709-4c9e-8563-72a98d1bac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:53.502640 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27187b93-3709-4c9e-8563-72a98d1bac62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:53.503597 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27187b93-3709-4c9e-8563-72a98d1bac62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:53.506071 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27187b93-3709-4c9e-8563-72a98d1bac62 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:53.521785 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1441/2887] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:36:53.526218 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efd69c-fcd1-432f-a0e5-d11e0b69c116 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:53.537029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efd69c-fcd1-432f-a0e5-d11e0b69c116 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:53.542565 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a809a7-f02a-4caf-aa10-0eacdd39ac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:53.543235 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a809a7-f02a-4caf-aa10-0eacdd39ac23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:53.543511 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a809a7-f02a-4caf-aa10-0eacdd39ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:53.543787 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a809a7-f02a-4caf-aa10-0eacdd39ac23 admin admin] PATH_INFO: `/v3/projects/0650c156ff6f421dbbdf40ee72e24b63/users/aa09184e72d94bffac84592f98952fca/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:53.560514 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a809a7-f02a-4caf-aa10-0eacdd39ac23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0650c156ff6f421dbbdf40ee72e24b63, user_id=aa09184e72d94bffac84592f98952fca, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:53.563295 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a809a7-f02a-4caf-aa10-0eacdd39ac23 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:53.579134 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1447/2888] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:36:53 2022] PUT /identity/v3/projects/0650c156ff6f421dbbdf40ee72e24b63/users/aa09184e72d94bffac84592f98952fca/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:36:53.583329 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27187b93-3709-4c9e-8563-72a98d1bac62 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:53.594453 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27187b93-3709-4c9e-8563-72a98d1bac62 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:53.665178 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f120-8f02-48e8-b067-c409c87c12ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:53.665938 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f120-8f02-48e8-b067-c409c87c12ed admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:53.666311 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f120-8f02-48e8-b067-c409c87c12ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:53.666562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f120-8f02-48e8-b067-c409c87c12ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:53.667339 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f120-8f02-48e8-b067-c409c87c12ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:53.668972 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f120-8f02-48e8-b067-c409c87c12ed admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:53.679304 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1442/2889] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Jul 26 07:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:36:53.683720 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a809a7-f02a-4caf-aa10-0eacdd39ac23 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:53.695567 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a809a7-f02a-4caf-aa10-0eacdd39ac23 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:53.702073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2d3f5-60e8-4eee-9941-522849c4688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:53.703000 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d3f5-60e8-4eee-9941-522849c4688d admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:53.703388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d3f5-60e8-4eee-9941-522849c4688d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:53.703733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d3f5-60e8-4eee-9941-522849c4688d admin admin] PATH_INFO: `/v3/projects/0650c156ff6f421dbbdf40ee72e24b63/users/aa09184e72d94bffac84592f98952fca/roles/d26c3014383f407e8d13f5a0ac4f7d8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:53.706772 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2d3f5-60e8-4eee-9941-522849c4688d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0650c156ff6f421dbbdf40ee72e24b63, user_id=aa09184e72d94bffac84592f98952fca, role_id=d26c3014383f407e8d13f5a0ac4f7d8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:53.710846 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2d3f5-60e8-4eee-9941-522849c4688d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:53.723686 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1448/2890] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Jul 26 07:36:53 2022] PUT /identity/v3/projects/0650c156ff6f421dbbdf40ee72e24b63/users/aa09184e72d94bffac84592f98952fca/roles/d26c3014383f407e8d13f5a0ac4f7d8a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:36:58.259186 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e300a-42b9-47ed-a2bc-9a747ca9f4e4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:58.259670 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e300a-42b9-47ed-a2bc-9a747ca9f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:58.259776 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e300a-42b9-47ed-a2bc-9a747ca9f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:58.315244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b20e300a-42b9-47ed-a2bc-9a747ca9f4e4 None None] MFA Rules not processed for user `aa09184e72d94bffac84592f98952fca`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:58.316862 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b20e300a-42b9-47ed-a2bc-9a747ca9f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:58.404592 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1443/2891] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:36:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:36:58.423793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2d3f5-60e8-4eee-9941-522849c4688d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:36:58.428458 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-59a2d3f5-60e8-4eee-9941-522849c4688d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:58.521208 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2d3f5-60e8-4eee-9941-522849c4688d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:36:58.527221 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cf3ed-39f8-44c6-ba10-219ca1001458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:36:58.527857 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cf3ed-39f8-44c6-ba10-219ca1001458 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:58.528098 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cf3ed-39f8-44c6-ba10-219ca1001458 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:58.528388 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cf3ed-39f8-44c6-ba10-219ca1001458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:58.589073 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cf3ed-39f8-44c6-ba10-219ca1001458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:36:58.590947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cf3ed-39f8-44c6-ba10-219ca1001458 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:36:58.601211 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1449/2892] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:36:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:36:59.647698 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e354-bbab-46de-a6f3-3c6a1e179469 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:36:59.648291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e354-bbab-46de-a6f3-3c6a1e179469 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:36:59.648291 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e354-bbab-46de-a6f3-3c6a1e179469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:36:59.670029 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d452e354-bbab-46de-a6f3-3c6a1e179469 None None] MFA Rules not processed for user `e31cb7b32ac3435295456f5b003ad43e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:36:59.671306 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d452e354-bbab-46de-a6f3-3c6a1e179469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:36:59.679973 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1444/2893] 10.222.0.20 () {58 vars in 958 bytes} [Tue Jul 26 07:36:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:37:08.596383 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:09.663896 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:30.971750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cf3ed-39f8-44c6-ba10-219ca1001458 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:37:30.973384 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-322cf3ed-39f8-44c6-ba10-219ca1001458 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:37:31.033828 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cf3ed-39f8-44c6-ba10-219ca1001458 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:37:31.037759 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed8a00-366e-446e-ac31-777832ffb8c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:37:31.038392 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed8a00-366e-446e-ac31-777832ffb8c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:37:31.038677 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed8a00-366e-446e-ac31-777832ffb8c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:37:31.038947 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed8a00-366e-446e-ac31-777832ffb8c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:37:31.048786 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed8a00-366e-446e-ac31-777832ffb8c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:37:31.050279 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed8a00-366e-446e-ac31-777832ffb8c7 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:37:31.064921 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1450/2894] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:37:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:37:32.711420 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452e354-bbab-46de-a6f3-3c6a1e179469 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:37:32.713066 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d452e354-bbab-46de-a6f3-3c6a1e179469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:37:32.729931 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452e354-bbab-46de-a6f3-3c6a1e179469 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:37:32.735613 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056016c-048c-4632-aa29-45bbb47e7714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:37:32.736252 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056016c-048c-4632-aa29-45bbb47e7714 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:37:32.736529 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056016c-048c-4632-aa29-45bbb47e7714 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:37:32.736805 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056016c-048c-4632-aa29-45bbb47e7714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:37:32.738632 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4056016c-048c-4632-aa29-45bbb47e7714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:37:32.751468 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056016c-048c-4632-aa29-45bbb47e7714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:37:32.753063 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056016c-048c-4632-aa29-45bbb47e7714 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:37:32.764450 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1445/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:37:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:37:41.056014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=26 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:37:42.759647 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:40.659076 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed8a00-366e-446e-ac31-777832ffb8c7 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.668726 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed8a00-366e-446e-ac31-777832ffb8c7 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.673440 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681acaa-ce12-4c09-a797-558251cc8b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.674077 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681acaa-ce12-4c09-a797-558251cc8b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.674359 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681acaa-ce12-4c09-a797-558251cc8b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.674629 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681acaa-ce12-4c09-a797-558251cc8b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.676737 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3681acaa-ce12-4c09-a797-558251cc8b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:40.688338 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681acaa-ce12-4c09-a797-558251cc8b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:40.689845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681acaa-ce12-4c09-a797-558251cc8b2c service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:40.699739 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1451/2896] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:38:50.695411 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:25.767282 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056016c-048c-4632-aa29-45bbb47e7714 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.777895 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056016c-048c-4632-aa29-45bbb47e7714 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.782939 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9efa8d-5b3e-4338-9873-4e95eefffbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.783562 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9efa8d-5b3e-4338-9873-4e95eefffbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.783838 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9efa8d-5b3e-4338-9873-4e95eefffbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.784105 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9efa8d-5b3e-4338-9873-4e95eefffbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.786166 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a9efa8d-5b3e-4338-9873-4e95eefffbe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:25.800180 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9efa8d-5b3e-4338-9873-4e95eefffbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:25.801705 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9efa8d-5b3e-4338-9873-4e95eefffbe5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.813245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1446/2897] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:39:27.007399 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681acaa-ce12-4c09-a797-558251cc8b2c service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.021107 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681acaa-ce12-4c09-a797-558251cc8b2c service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.028008 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5a3b8-f1c0-4993-9ed1-df678b2a278f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.028812 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5a3b8-f1c0-4993-9ed1-df678b2a278f service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.029131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5a3b8-f1c0-4993-9ed1-df678b2a278f service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.029528 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5a3b8-f1c0-4993-9ed1-df678b2a278f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.032653 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-65b5a3b8-f1c0-4993-9ed1-df678b2a278f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:27.048970 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5a3b8-f1c0-4993-9ed1-df678b2a278f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.050441 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5a3b8-f1c0-4993-9ed1-df678b2a278f service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.061620 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1452/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:39:35.808013 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:37.056893 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:39.269148 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3ee40-e33e-4af6-a06d-695b366c4e39 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.269765 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3ee40-e33e-4af6-a06d-695b366c4e39 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.269872 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3ee40-e33e-4af6-a06d-695b366c4e39 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.271378 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1447/2899] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:39.278807 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ce02e-7344-431c-bf63-d3eb1aeb68ea None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.279430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ce02e-7344-431c-bf63-d3eb1aeb68ea None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.279430 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ce02e-7344-431c-bf63-d3eb1aeb68ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.332845 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2f8ce02e-7344-431c-bf63-d3eb1aeb68ea None None] MFA Rules not processed for user `7eab2497edff4c968030b5b0d6814150`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:39.334158 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2f8ce02e-7344-431c-bf63-d3eb1aeb68ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:39.340899 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1453/2900] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:39:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:39:39.358519 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3ee40-e33e-4af6-a06d-695b366c4e39 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.369711 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3ee40-e33e-4af6-a06d-695b366c4e39 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.373421 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84c1c7-e115-4118-97eb-bf6bdf0ee210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.374070 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84c1c7-e115-4118-97eb-bf6bdf0ee210 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.374342 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84c1c7-e115-4118-97eb-bf6bdf0ee210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.374759 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84c1c7-e115-4118-97eb-bf6bdf0ee210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.382494 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84c1c7-e115-4118-97eb-bf6bdf0ee210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.384140 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84c1c7-e115-4118-97eb-bf6bdf0ee210 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.393716 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1448/2901] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:39:39.482014 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541d02d-fe08-4b30-819e-a86039402741 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.482300 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541d02d-fe08-4b30-819e-a86039402741 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.482576 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541d02d-fe08-4b30-819e-a86039402741 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.483979 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1454/2902] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 26 07:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:39.490987 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0181904-2f59-416d-a156-bb65bf92b33c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.491276 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0181904-2f59-416d-a156-bb65bf92b33c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.491619 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0181904-2f59-416d-a156-bb65bf92b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.532676 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d0181904-2f59-416d-a156-bb65bf92b33c None None] MFA Rules not processed for user `c70a0ca34a3940d1b067430c9c2dc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:39.533948 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d0181904-2f59-416d-a156-bb65bf92b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:39.543988 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1449/2903] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 26 07:39:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:39:39.559534 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541d02d-fe08-4b30-819e-a86039402741 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.572993 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541d02d-fe08-4b30-819e-a86039402741 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.577009 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9c28-ba9f-47e2-a65f-079dd6c3ff1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eab2497edff4c968030b5b0d6814150', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.577660 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9c28-ba9f-47e2-a65f-079dd6c3ff1f service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.577923 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9c28-ba9f-47e2-a65f-079dd6c3ff1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.578196 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9c28-ba9f-47e2-a65f-079dd6c3ff1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.589029 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9c28-ba9f-47e2-a65f-079dd6c3ff1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.590513 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9c28-ba9f-47e2-a65f-079dd6c3ff1f service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.601876 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1455/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:39:39.667764 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0181904-2f59-416d-a156-bb65bf92b33c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.669582 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d0181904-2f59-416d-a156-bb65bf92b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:39.741846 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0181904-2f59-416d-a156-bb65bf92b33c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.747610 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c79d1-33e3-45d7-b347-dbcde2f33cd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.748245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c79d1-33e3-45d7-b347-dbcde2f33cd4 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.748526 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c79d1-33e3-45d7-b347-dbcde2f33cd4 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.748796 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c79d1-33e3-45d7-b347-dbcde2f33cd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.750699 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5a2c79d1-33e3-45d7-b347-dbcde2f33cd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:39.763386 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c79d1-33e3-45d7-b347-dbcde2f33cd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.764978 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c79d1-33e3-45d7-b347-dbcde2f33cd4 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.776038 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1450/2905] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:39:42.656602 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9c28-ba9f-47e2-a65f-079dd6c3ff1f service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:42.669520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9c28-ba9f-47e2-a65f-079dd6c3ff1f service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:42.675804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:42.676450 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.676733 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.677013 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.679041 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:42.697183 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:42.699229 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:42.710596 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1456/2906] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:39:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:39:49.771244 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=47 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:52.705848 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=25 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:01.545107 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c79d1-33e3-45d7-b347-dbcde2f33cd4 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:01.560535 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c79d1-33e3-45d7-b347-dbcde2f33cd4 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:01.567713 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545b22c-8172-4fe1-81eb-cc6409248c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a0ca34a3940d1b067430c9c2dc64e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:01.568467 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545b22c-8172-4fe1-81eb-cc6409248c2f service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:01.568807 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545b22c-8172-4fe1-81eb-cc6409248c2f service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:01.569144 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545b22c-8172-4fe1-81eb-cc6409248c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:01.571258 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6545b22c-8172-4fe1-81eb-cc6409248c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:01.586520 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545b22c-8172-4fe1-81eb-cc6409248c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:01.588233 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545b22c-8172-4fe1-81eb-cc6409248c2f service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:01.600371 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1451/2907] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:41:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:41:05.984551 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:05.986155 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:06.001595 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68945cc-8c1f-47a7-b7be-cf612358f9a9 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:06.007232 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad884-9f40-4521-9fe5-11427ed0caba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:06.007858 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad884-9f40-4521-9fe5-11427ed0caba service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:06.008137 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad884-9f40-4521-9fe5-11427ed0caba service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:06.008407 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad884-9f40-4521-9fe5-11427ed0caba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:06.012934 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c09ad884-9f40-4521-9fe5-11427ed0caba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:06.025940 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ad884-9f40-4521-9fe5-11427ed0caba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:06.029315 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ad884-9f40-4521-9fe5-11427ed0caba service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:06.041010 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1457/2908] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:41:09.059584 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545b22c-8172-4fe1-81eb-cc6409248c2f service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:09.072465 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545b22c-8172-4fe1-81eb-cc6409248c2f service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:09.078599 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865c6b-96df-4aeb-a677-fb19209714a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:09.079402 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865c6b-96df-4aeb-a677-fb19209714a7 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:09.079858 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865c6b-96df-4aeb-a677-fb19209714a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:09.080245 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865c6b-96df-4aeb-a677-fb19209714a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:09.082503 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-43865c6b-96df-4aeb-a677-fb19209714a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:09.103498 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865c6b-96df-4aeb-a677-fb19209714a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:09.105185 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865c6b-96df-4aeb-a677-fb19209714a7 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:09.116929 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1452/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:41:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:41:09.128701 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad884-9f40-4521-9fe5-11427ed0caba service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:09.196212 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad884-9f40-4521-9fe5-11427ed0caba service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:09.201084 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:09.201774 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:09.202050 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:09.202320 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] PATH_INFO: `/v3/users/e31cb7b32ac3435295456f5b003ad43e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:09.203486 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31cb7b32ac3435295456f5b003ad43e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:09.205792 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:09.254870 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31cb7b32ac3435295456f5b003ad43e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.255425 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31cb7b32ac3435295456f5b003ad43e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.256018 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31cb7b32ac3435295456f5b003ad43e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.268064 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31cb7b32ac3435295456f5b003ad43e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.278880 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31cb7b32ac3435295456f5b003ad43e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.290909 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1458/2910] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:41:09 2022] DELETE /identity/v3/users/e31cb7b32ac3435295456f5b003ad43e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:41:09.486382 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865c6b-96df-4aeb-a677-fb19209714a7 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:09.499364 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865c6b-96df-4aeb-a677-fb19209714a7 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:09.562377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:09.563032 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:09.563308 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:09.563587 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] PATH_INFO: `/v3/projects/37cd424fff6c4ebaae4618a08c9a12f2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:09.565097 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] RBAC: Authorizing `identity:delete_project(project_id=37cd424fff6c4ebaae4618a08c9a12f2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:09.567031 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:09.617952 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cd424fff6c4ebaae4618a08c9a12f2', 'request_id': 'req-d7af6e7d-ed6e-4039-b362-34e8c651a52e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.627664 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cd424fff6c4ebaae4618a08c9a12f2', 'request_id': 'req-d7af6e7d-ed6e-4039-b362-34e8c651a52e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.634433 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cd424fff6c4ebaae4618a08c9a12f2', 'request_id': 'req-d7af6e7d-ed6e-4039-b362-34e8c651a52e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.645992 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] The token cache is being invalidate because project 37cd424fff6c4ebaae4618a08c9a12f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:41:09.646280 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.646957 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.648493 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1453/2911] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:41:09 2022] DELETE /identity/v3/projects/37cd424fff6c4ebaae4618a08c9a12f2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:41:09.653131 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:09.654825 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:09.668793 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a35d2c-cdaf-4f0a-8ee0-cf6f03721d60 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:09.728589 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:09.729251 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:09.729554 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:09.729826 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] PATH_INFO: `/v3/users/aa09184e72d94bffac84592f98952fca` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:09.731043 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa09184e72d94bffac84592f98952fca)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:09.733005 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:09.739108 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:09.790296 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa09184e72d94bffac84592f98952fca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.790885 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa09184e72d94bffac84592f98952fca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.791489 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa09184e72d94bffac84592f98952fca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.804371 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa09184e72d94bffac84592f98952fca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.814483 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa09184e72d94bffac84592f98952fca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:09.828355 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1459/2912] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Jul 26 07:41:09 2022] DELETE /identity/v3/users/aa09184e72d94bffac84592f98952fca => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:41:10.025241 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:10.026747 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:10.043377 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af6e7d-ed6e-4039-b362-34e8c651a52e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:10.106789 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e22a2638d8e425c934033b96ce6b062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d27a777014952aa29c6bcc39dc4ed', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:10.108196 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:10.108656 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:10.108913 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] PATH_INFO: `/v3/projects/0650c156ff6f421dbbdf40ee72e24b63` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:10.110184 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0650c156ff6f421dbbdf40ee72e24b63)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:10.112060 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:10.119247 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:10.168256 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0650c156ff6f421dbbdf40ee72e24b63', 'request_id': 'req-dea1d3bf-265b-484f-b7ad-66fb332e5fba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:10.178740 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0650c156ff6f421dbbdf40ee72e24b63', 'request_id': 'req-dea1d3bf-265b-484f-b7ad-66fb332e5fba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:10.186918 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0650c156ff6f421dbbdf40ee72e24b63', 'request_id': 'req-dea1d3bf-265b-484f-b7ad-66fb332e5fba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:10.200124 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] The token cache is being invalidate because project 0650c156ff6f421dbbdf40ee72e24b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:41:10.200416 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:10.201150 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dea1d3bf-265b-484f-b7ad-66fb332e5fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:41:10.202783 dv-cinder-850836-1-smb devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1454/2913] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Jul 26 07:41:10 2022] DELETE /identity/v3/projects/0650c156ff6f421dbbdf40ee72e24b63 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:41:19.824594 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:20.196648 dv-cinder-850836-1-smb devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:47.985520 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:47.987231 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:48.076154 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73ac25-e31b-4c57-9844-f7de7ef6c239 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:48.141572 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ecaf2-ea06-42cb-b532-2ebfab1204a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '826fd481bf2e40d6917bb604591a75cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6564e74c0f8945f1a29a3ffc15482594', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:48.142224 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ecaf2-ea06-42cb-b532-2ebfab1204a9 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:48.142533 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ecaf2-ea06-42cb-b532-2ebfab1204a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:48.142804 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ecaf2-ea06-42cb-b532-2ebfab1204a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:48.144713 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c74ecaf2-ea06-42cb-b532-2ebfab1204a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:48.157750 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ecaf2-ea06-42cb-b532-2ebfab1204a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:48.159373 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ecaf2-ea06-42cb-b532-2ebfab1204a9 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:48.170715 dv-cinder-850836-1-smb devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1460/2914] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 26 07:41:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:41:58.165945 dv-cinder-850836-1-smb devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=58 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}